-- Logs begin at Thu 2022-08-18 19:38:43 UTC, end at Thu 2022-08-18 21:19:48 UTC. -- Aug 18 20:44:21.609918 dv-cinder-852654-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 20:44:21.619026 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 20:44:21 2022] *** Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: nodename: dv-cinder-852654-2-iscsi Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: machine: x86_64 Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: clock source: unix Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: pcre jit disabled Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: detected number of CPU cores: 4 Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: current working directory: / Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: detected binary path: /usr/bin/uwsgi-core Aug 18 20:44:21.621070 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: your processes number limit is 47680 Aug 18 20:44:21.621879 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: your memory page size is 4096 bytes Aug 18 20:44:21.621879 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: detected max file descriptor number: 2048 Aug 18 20:44:21.621879 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: lock engine: pthread robust mutexes Aug 18 20:44:21.621879 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: thunder lock: enabled Aug 18 20:44:21.621879 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 20:44:21.621879 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 20:44:21.661020 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: Python main interpreter initialized at 0x564cdeb0a9c0 Aug 18 20:44:21.661020 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: python threads support enabled Aug 18 20:44:21.661020 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: your server socket listen backlog is limited to 100 connections Aug 18 20:44:21.661020 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: your mercy for graceful operations on workers is 90 seconds Aug 18 20:44:21.661443 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 20:44:21.661443 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: *** Operational MODE: preforking *** Aug 18 20:44:21.661716 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: *** uWSGI is running in multiple interpreter mode *** Aug 18 20:44:21.661716 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: spawned uWSGI master process (pid: 112814) Aug 18 20:44:21.661927 dv-cinder-852654-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 20:44:21.662767 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: spawned uWSGI worker 1 (pid: 112815, cores: 1) Aug 18 20:44:21.662966 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: spawned uWSGI worker 2 (pid: 112816, cores: 1) Aug 18 20:44:21.663138 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 20:44:22.322572 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 20:44:22.356490 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 20:44:23.553005 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:44:23.553005 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: from cryptography.utils import int_from_bytes Aug 18 20:44:23.553590 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:44:23.553590 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: from cryptography.utils import int_from_bytes Aug 18 20:44:23.600495 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:44:23.600495 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: from cryptography.utils import int_from_bytes Aug 18 20:44:23.601059 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:44:23.601059 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: from cryptography.utils import int_from_bytes Aug 18 20:44:26.066124 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:44:26.066694 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:44:26.066896 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:44:26.067247 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:44:26.067532 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:44:26.067638 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:44:26.067999 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:44:26.068089 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.068226 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.068410 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:44:26.068540 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.068775 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:44:26.068865 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.069040 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:44:26.069176 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.069430 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.069553 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.069755 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.069854 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.070067 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.070179 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.070386 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.070514 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.070638 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.070736 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.070946 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.071042 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.071264 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-2-iscsi {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.071383 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.071603 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.071694 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.071905 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.071994 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.072208 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.072307 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.072522 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.072630 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.072827 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.072933 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-2-iscsi {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.073143 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.073232 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.073440 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.073536 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.073749 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.073962 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.074109 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.075258 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.075428 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.075549 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.075685 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.075824 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.075950 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076074 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076197 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076342 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076480 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076596 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076728 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076853 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.076966 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.077088 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.077226 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.077358 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.077482 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.077606 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.077736 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.077874 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-2-iscsi {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078015 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078148 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078262 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078399 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078520 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078643 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.078896 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079031 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-2-iscsi {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079170 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079296 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079435 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079573 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079711 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079865 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.079985 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.080239 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.080362 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.080562 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.080730 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.080871 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.081012 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.081209 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.081364 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.081512 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.081660 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.081800 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.081947 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.082100 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.082242 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.082380 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.082551 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.082712 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.082870 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.083099 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.083264 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.083428 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.083585 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.083743 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.083883 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.084036 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.084175 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.084321 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.084468 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.084608 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.084746 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.084894 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.085048 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.085248 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.085395 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.085534 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.085689 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.085829 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.085969 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.086107 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.086253 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.086395 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.086542 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.086710 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.086859 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.087007 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.087146 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.087299 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.087483 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.087638 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.087778 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.087926 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.088065 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.088213 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.088360 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.088511 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.088650 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.088789 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.088935 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.089075 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.089213 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.089358 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.089507 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.089655 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.089803 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.089982 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.090216 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.090401 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.090590 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.090731 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.090878 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091018 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091155 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091293 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091461 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091617 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091766 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091913 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.091913 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.092195 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.092195 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.092484 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.092625 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.092775 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.092775 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.093037 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.093262 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.093417 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.093572 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.093712 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.093857 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.093997 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.094143 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.094296 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.094445 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.094584 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.094732 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.094871 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.095009 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.095159 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.095337 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.095551 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.095700 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.095847 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.096001 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.096147 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.096303 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.096442 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.096581 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.096718 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.096866 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097009 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097148 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097287 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097424 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097569 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097718 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097858 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.097997 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.098182 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.098327 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.098466 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.098613 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.098751 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.098890 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.099028 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.099165 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.099303 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.099546 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.099698 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.099838 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.099985 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.100135 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.100366 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.100513 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.100651 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.100820 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.100976 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.101116 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.101260 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.101407 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.101547 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.101692 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.101832 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.101978 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.102137 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.102278 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.102424 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.102563 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.102725 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.102881 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.103021 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.103169 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.103409 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.103567 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.103708 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.103846 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.103993 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.104144 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.104283 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.104421 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.104567 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.104714 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.104863 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105009 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105149 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105289 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105471 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105645 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105798 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105947 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.105947 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.106212 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.106359 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.106498 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.106646 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.106786 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.106924 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.107062 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.107201 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.107403 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.107554 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.107693 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.107842 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.108481 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.108621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.108780 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.108922 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.109098 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.109245 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.109385 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.109525 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.109673 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.109843 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.110040 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.110204 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.110383 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.110606 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.110759 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.110900 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.111039 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.111178 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.111316 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.111316 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.111622 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.111763 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.112052 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.112207 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:44:26.112348 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.112348 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.112648 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.112815 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.112956 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.113095 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.113242 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.113411 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.113631 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.113783 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.113922 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.114062 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.114210 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.114360 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.114508 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.114648 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.114786 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.114932 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.115080 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.115227 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.115402 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.115589 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.115735 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.115903 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.116052 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.116205 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.116355 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.116495 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.116634 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.116774 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.116921 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.117075 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.117224 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.117372 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.117512 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.117650 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.117803 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.117943 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.118091 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.118231 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.118369 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.118508 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.118655 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.118795 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.118934 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.119073 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.119212 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.119350 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.119527 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.119681 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.119821 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.119971 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.120111 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.120335 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.120476 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.120633 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.120633 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.120970 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.121118 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.121268 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.121408 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.121556 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.121703 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.121850 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.122005 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.122153 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.122300 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.122448 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.122587 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.122735 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.122875 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.123025 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.123173 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.123313 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.123562 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124292 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124403 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124497 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124578 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124656 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124733 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124823 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124913 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.124992 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125069 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125145 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125231 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125309 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125396 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125475 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125552 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125627 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125701 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125777 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.125868 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.126069 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.126174 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.126380 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.126470 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.126691 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.126788 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.127001 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.127089 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.127305 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.127443 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.127646 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.127743 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.127945 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.128033 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.128242 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.128338 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.128546 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.128642 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.128849 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.128942 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.129148 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.129234 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.129465 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.129560 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.129766 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.129854 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.130066 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.130162 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.130373 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.130459 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.130669 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.130755 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.130966 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.131078 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.131276 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.131399 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.131601 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.131689 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.131905 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.132000 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.132210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.132304 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.132514 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.132602 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.132816 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.132911 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.133133 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.133218 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.133434 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.133527 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.133737 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.133825 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.134050 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.134139 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.134359 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.134460 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.134671 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.134767 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.134980 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.135075 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.135288 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.135410 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.135620 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.135710 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.135925 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.136012 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.136226 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.136314 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.136526 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.136615 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.136824 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.136912 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.137126 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.137225 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.137425 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.137512 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.137724 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.137811 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.138022 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.138117 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.138319 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.138406 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.138616 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.138701 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.138938 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.139050 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.139794 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.139888 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.140060 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.140147 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.140359 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.140454 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.140657 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.140752 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.140990 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.141083 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.141293 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.141404 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.141594 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.141690 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.141896 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.141991 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.142219 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.142314 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.142524 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.142618 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.142827 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.142980 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.143131 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.143293 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.143473 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.143616 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.143764 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.143904 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.144065 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.144206 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.144344 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.144882 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.145024 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.145174 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.145322 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.145471 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.145623 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.145806 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.145954 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.146113 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.146254 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.146402 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.146541 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.146720 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.146862 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.147010 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.147151 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.147291 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.147463 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.147622 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.147763 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.147912 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.148060 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.148202 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.148342 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.148489 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.148630 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.148853 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.148995 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.149136 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.149285 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.149433 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.149598 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.149740 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.149880 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.150026 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.150167 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.150308 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.150468 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.150622 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.150769 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.150916 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.151088 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.151312 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.151512 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.151663 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.151810 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.151956 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.152102 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.152256 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.152413 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.152560 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.152706 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.152852 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.152999 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.153145 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.153300 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.153466 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.153614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.153760 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.153906 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.154073 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.154227 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.154374 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.154520 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.154674 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.155578 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.155767 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.155960 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.156114 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.156273 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.156421 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.156570 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.156726 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.156872 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.157019 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.157165 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.157165 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.157452 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.157608 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.157762 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.157919 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.158075 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.158232 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.158388 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.158534 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.158681 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.158827 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.158982 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.159129 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.159284 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.159453 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.159602 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.159750 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.159895 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.160052 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.160223 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.160378 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.160524 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.160676 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.160823 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.160969 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.161123 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.161296 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.161520 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.161672 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.161820 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.161979 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.162138 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.162286 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.162440 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.162586 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.162731 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.162888 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.163034 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.163189 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.163344 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.163530 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.163676 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.163833 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.163988 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.164156 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.164303 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.164449 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.164595 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.164750 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.164905 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.165140 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.165291 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.165449 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.165686 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.165839 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.166037 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.166188 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.166345 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.166491 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.166646 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.166799 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.166945 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.167100 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.167253 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.167433 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.167602 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.167750 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.167904 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.168050 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.168197 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.168353 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.168508 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.168655 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.168801 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.168946 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.169091 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.169247 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.169393 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.169547 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.169694 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.169839 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.169984 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.170163 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.170311 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.170457 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.170609 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.170763 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.170908 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.171068 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.171214 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.171214 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.171648 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.171803 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.171949 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.172104 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.172270 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.172418 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.172564 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.172710 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.172870 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.173018 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.173164 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.173317 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.173464 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.173619 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.173775 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.173930 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.174100 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.174100 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.174391 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.174538 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.174692 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.174853 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.175000 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.175166 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.175402 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.175560 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.175785 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.176016 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.176016 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.176346 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.176505 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.176658 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.176813 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.176969 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.177115 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.177261 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.177421 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.177580 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.177734 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.177889 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.178045 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.178200 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.178357 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.178504 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.178651 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.178804 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.178964 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.179119 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.179272 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.179483 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.179639 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.179799 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.179946 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.180093 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.180245 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.180403 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.180549 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.180706 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.180861 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.181008 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.181153 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.181300 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.181445 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.181618 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.181837 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.181989 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.182134 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.182281 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.182437 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.182593 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.182741 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.182895 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.183042 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.183189 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.183344 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.183520 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.183668 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.183815 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.183969 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.184119 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.184278 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.184436 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.184583 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.184729 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.184875 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.185021 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.185176 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.185323 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.185550 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.185703 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.185938 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.186092 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.186300 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.186467 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.186614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.186614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.186892 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.187048 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.187194 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.187348 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.187533 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.187691 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.187838 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.187993 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.188140 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.188294 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.188451 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.188597 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.188742 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.188897 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.189052 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.189198 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.189343 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.189489 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.189633 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.189788 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.189935 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.190089 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.190236 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.190392 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.190547 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.190702 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.190848 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.190994 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.191141 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.191294 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.191482 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.191631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.191777 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.192005 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.192158 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.192313 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.192484 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.192632 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.192778 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.192931 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.193078 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.193232 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.193388 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.193535 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.193688 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.193835 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.193991 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.194147 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.194306 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.194459 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.194613 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.194768 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.194916 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.195071 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.195219 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.195415 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.195585 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.195800 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.195982 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.196145 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.196332 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.196496 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.196642 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.196787 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.196933 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.197088 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.197234 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.197388 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.197549 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.197705 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.197860 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.198014 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.198161 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.198307 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.198462 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.198610 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.198764 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.198912 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.199057 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.199210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.199375 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.199532 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.199695 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.199849 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.199995 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.200141 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.200287 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.200442 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.200599 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.200752 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.200898 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.201043 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.201199 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.201355 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.201510 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.202199 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.202419 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.202572 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.202719 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.202944 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.203103 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.203250 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.203452 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.203615 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.203765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.203931 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.204086 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.204232 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.204377 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.204523 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.204669 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.204824 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.204989 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.205136 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.205282 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.205428 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.205582 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.205782 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.206016 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.206168 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.206168 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.206501 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.206501 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.206794 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.206940 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.207097 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.207242 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.207410 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.207410 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.207716 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.207870 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.208018 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.208170 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.208326 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.208486 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.208633 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.208778 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.208924 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.209082 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.209236 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.209395 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.209542 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.209688 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.209834 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.209979 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.210136 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.210283 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.210436 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.210582 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.210736 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.210883 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.211047 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.211196 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.211342 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.211545 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.211692 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.211847 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.212004 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.212152 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.212305 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.212542 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.212695 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.212842 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.213012 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.213161 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.213308 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.213453 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.213598 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.213751 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.213907 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.214055 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.214200 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.214347 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.214501 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.214656 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.214803 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.214964 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.215111 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.215258 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.215427 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.215595 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.215752 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.215900 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.216129 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.216282 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.216481 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.216642 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.216796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.216950 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.217115 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.217262 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.217463 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.217612 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.217759 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.217912 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.218556 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.218708 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.218864 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.219012 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.219165 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.219312 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.219501 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.219670 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.219826 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.219972 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.220127 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.220280 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.220435 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.220589 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.220744 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.220891 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.221044 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.221190 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.221335 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.221504 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.221652 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.221805 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.221952 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.222107 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.222254 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.222408 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.222573 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.222803 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.222962 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.223108 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.223254 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.223436 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.223606 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.223755 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.223920 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.224068 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.224220 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.224376 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.224522 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.224667 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.224813 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.224959 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.225114 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.225260 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.225406 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.225568 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.225716 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.225863 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.226017 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.226247 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.226400 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.226597 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.226748 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.226897 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.227052 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.227224 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.227224 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.227608 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.227758 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.227913 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.228059 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.228205 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.228360 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.228506 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.228506 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.228784 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.228932 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.229119 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.229283 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.229438 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.229596 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.229743 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.229891 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.230048 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.230195 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.230349 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.230495 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.230641 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.230788 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.230946 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.231104 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.231259 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.231427 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.231591 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.231737 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.231895 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.231895 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.232183 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.232338 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.232485 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.232631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.232805 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.233050 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.233205 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.233353 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.233498 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.233663 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.233816 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.233968 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.234123 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.234270 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.234425 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.234585 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.234738 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.234892 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.235046 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.235194 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.235346 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.235577 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.235732 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.235880 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.236026 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.236171 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.236400 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.236564 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.236757 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.236910 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.237064 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.237212 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.237368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.237514 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.237671 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.237818 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.237963 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.238116 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.238271 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.238418 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.238564 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.238717 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.238870 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.239016 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.239172 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.239319 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.239492 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.239670 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.239828 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.239984 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.240138 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.240285 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.240432 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.240585 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.240739 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.240895 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.241042 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.241195 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.241342 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.241496 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.241654 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.241810 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.241958 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.242104 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.242250 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.242397 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.242544 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.242737 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.242886 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.243061 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.243061 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.243470 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.243635 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.243798 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.243950 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.244098 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.244245 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.244391 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.244547 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.244695 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.244871 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.245018 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.245179 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.245328 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.245487 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.245646 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.245801 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.245948 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.246095 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.246240 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.246414 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.246643 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.246742 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.246828 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.246911 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247010 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247102 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247192 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247274 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247354 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247471 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247566 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247649 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247736 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247816 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247895 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.247973 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.248061 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.248151 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.248233 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.248312 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.248391 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.248479 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249156 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249242 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249329 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249409 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249496 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249665 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249753 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249843 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.249843 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250037 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250146 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250229 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250308 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250387 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250465 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250544 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250632 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250713 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250792 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250877 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.250967 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251048 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251140 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251221 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251300 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251396 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251479 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251584 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251584 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251752 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251752 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251907 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.251988 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252085 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252173 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252254 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252334 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252419 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252419 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252574 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252655 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252743 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252831 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.252919 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253076 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253159 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253239 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253318 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253385 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253450 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253537 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253619 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253698 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253784 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253863 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.253942 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.254030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.254221 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.254323 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.254529 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.254620 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.254838 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.254928 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.255144 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.255236 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.255471 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.255564 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.255775 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.255868 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.256079 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.256168 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.256386 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.256474 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.256709 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.256809 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.257037 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.257134 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.257349 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.257448 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.257657 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.257746 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.257961 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.258060 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.258269 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.258369 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.258584 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.258788 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.258885 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.259103 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.259252 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.259459 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.259553 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.259785 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.259883 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.260106 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.260205 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.260417 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.260505 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.260723 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.260811 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.261032 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.261130 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.261336 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.261424 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.261637 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.261726 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.261943 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.262042 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.262245 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.262334 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.262544 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.262632 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.262862 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.262959 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.263173 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.263261 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.263508 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.263724 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.263826 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.264046 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.264143 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.264945 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.265181 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.265271 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.265532 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.265623 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.265846 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.265935 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.266169 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.266267 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.266491 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.266587 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.266804 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.266959 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.267135 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.267235 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.267434 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.267557 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.267755 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.267855 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.268031 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.268134 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.268339 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.268433 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.268643 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.268738 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.268942 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.269045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.269237 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.269346 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.269906 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.270013 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.270095 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.270328 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.270424 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.270668 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.270759 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.270966 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.271143 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.271302 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.271484 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.271633 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.271789 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.271944 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.272099 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.272254 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.272401 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.272547 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.272693 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.272840 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.272996 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.273161 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.273309 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.273455 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.273688 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.273849 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.274005 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.274153 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.274306 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.274453 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.274599 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.274758 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.274904 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.275052 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.275218 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.275399 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.275555 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.275723 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.275875 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.276023 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.276169 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.276315 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.276461 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.276635 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.276788 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.277028 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.277183 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.277342 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.277498 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.277654 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.277801 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.277949 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.278095 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.278242 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.278397 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.278546 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.278692 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.278838 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.278991 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.279157 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.279314 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.279485 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.279645 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.279645 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.280069 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.280222 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.280379 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.280535 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.280683 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.280829 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.280977 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.281132 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.281294 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.281442 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.281595 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.281742 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.281896 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.282117 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.282267 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.282415 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.282561 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.282707 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.282852 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.283008 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.283154 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.283311 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.283493 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.283642 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.283788 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.283946 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.284093 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.284240 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.284393 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.284393 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.284684 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.284831 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.284985 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.285144 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.285290 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.285446 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.285446 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.285758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.285907 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.286053 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.286208 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.286356 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.286511 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.286667 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.286814 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.286959 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.287143 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.287301 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.287474 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.287622 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.287768 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.287915 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.288072 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.288229 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.288376 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.288522 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.288669 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.288814 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.288976 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.289138 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.289293 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.289440 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.289599 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.289755 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.289902 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.290075 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.290303 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.290456 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.290611 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.290759 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.290915 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.291074 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.291074 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.291352 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.291543 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.291690 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.291850 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.291997 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.292143 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.292290 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.292290 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.292568 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.292724 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.292884 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.293038 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.293193 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.293340 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.293495 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.293643 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.293796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.293945 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.294092 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.294238 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.294393 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.294393 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.294680 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.294837 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.294985 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.295131 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.295288 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.295288 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.295638 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.295797 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.295952 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.296110 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.296258 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.296404 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.296561 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.296719 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.296875 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.297031 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.297180 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.297335 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.297481 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.297628 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.297774 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.297933 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.298080 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.298227 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.298373 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.298544 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.298544 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.298841 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.298989 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.299136 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.299282 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.299496 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.299659 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.299806 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.299951 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.300097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.300246 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.300475 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.300648 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.300797 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.300944 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.301090 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.301237 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.301385 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.301541 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.301688 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.301834 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.301981 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.302128 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.302282 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.302431 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.302617 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.302767 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.302913 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.303067 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.303223 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.303395 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.303549 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.303695 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.303842 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.303988 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.304146 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.304294 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.304464 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.304619 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.304765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.304911 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.305065 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.305214 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.305361 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.305508 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.305659 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.305855 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.306014 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.306162 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.306308 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.306468 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.306616 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.306771 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.306919 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.307065 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.307211 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.307417 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.307574 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.307738 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.307893 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.308048 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.308194 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.308341 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.308505 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.308663 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.308819 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.308966 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.309113 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.309259 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.309414 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.309561 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.309707 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.309860 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.310008 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.310155 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.310385 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.310617 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.310772 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.310919 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.311603 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.311705 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.311811 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.311908 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.311994 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312075 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312156 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312250 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312334 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312415 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312503 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312585 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312665 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312754 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312844 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.312926 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313006 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313090 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313171 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313260 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313343 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313430 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313513 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313593 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313682 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313765 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.313920 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.314019 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.314221 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.314320 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.314537 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.314640 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.314852 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.314946 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.315176 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.315339 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.315535 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.315683 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.315830 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.315977 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.316124 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.316323 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.316478 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.316633 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.316780 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.316927 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.317084 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.317241 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.317241 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:44:26.317528 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.317686 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.317904 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.318213 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.318521 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.318832 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.319147 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.319511 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.319822 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.320131 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.320457 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.320785 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.321133 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.321443 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.321788 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.322119 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.322436 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.322748 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.323053 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:44:26.323297 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112816) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:44:26.471545 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO dbcounter [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Registered counter for database nova_api Aug 18 20:44:26.477649 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO dbcounter [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Registered counter for database nova_api Aug 18 20:44:26.491604 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.498035 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_db.sqlalchemy.engines [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.498384 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writer thread running {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:26.509033 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writer thread running {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:26.564307 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.context [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81167f5b-f1a0-4b68-bbb4-89664992faba(cell1) {{(pid=112815) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 20:44:26.568471 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:44:26.568887 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:44:26.570497 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:44:26.571197 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:44:26.571794 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:44:26.573808 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:44:26.575876 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO dbcounter [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Registered counter for database nova_cell0 Aug 18 20:44:26.576265 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.context [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81167f5b-f1a0-4b68-bbb4-89664992faba(cell1) {{(pid=112816) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 20:44:26.580851 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_concurrency.lockutils [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:44:26.581335 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_concurrency.lockutils [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:44:26.582261 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO dbcounter [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Registered counter for database nova_cell1 Aug 18 20:44:26.582923 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_concurrency.lockutils [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:44:26.583717 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_concurrency.lockutils [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:44:26.584195 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_concurrency.lockutils [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:44:26.586184 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_concurrency.lockutils [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112816) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:44:26.588289 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO dbcounter [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Registered counter for database nova_cell0 Aug 18 20:44:26.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.593093 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.594267 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO dbcounter [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Registered counter for database nova_cell1 Aug 18 20:44:26.596488 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writer thread running {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:26.601421 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_db.sqlalchemy.engines [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.603210 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_db.sqlalchemy.engines [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.608812 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writer thread running {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:26.611863 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writer thread running {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:26.735478 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writer thread running {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:26.745392 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO dbcounter [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Registered counter for database nova_cell0 Aug 18 20:44:26.753424 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_db.sqlalchemy.engines [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.757808 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO dbcounter [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Registered counter for database nova_cell0 Aug 18 20:44:26.757969 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writer thread running {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:26.765477 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG oslo_db.sqlalchemy.engines [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112816) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:44:26.770152 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writer thread running {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:44:27.176964 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: WARNING keystonemiddleware.auth_token [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:44:27.184196 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: WARNING keystonemiddleware.auth_token [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:44:27.212064 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: WARNING keystonemiddleware.auth_token [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:44:27.219434 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: WARNING keystonemiddleware.auth_token [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:44:27.526579 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: WARNING keystonemiddleware.auth_token [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:44:27.532591 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: WARNING keystonemiddleware.auth_token [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:44:27.537796 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564cdeb0a9c0 pid: 112815 (default app) Aug 18 20:44:27.539879 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:44:27.541046 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Aug 18 20:44:27.541460 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Thu Aug 18 20:44:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:44:27.564287 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: WARNING keystonemiddleware.auth_token [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:44:27.570275 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: WARNING keystonemiddleware.auth_token [None req-cef59c67-d725-4a5e-8bd8-05f19191d13c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:44:27.575597 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564cdeb0a9c0 pid: 112816 (default app) Aug 18 20:45:49.811248 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:45:49.812384 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 18 20:45:49.812861 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:45:49.825657 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writing DB stats nova_api:SELECT=3 {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:49.826814 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writing DB stats nova_cell0:SELECT=3 {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:49.827683 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writing DB stats nova_cell1:SELECT=3 {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:49.828987 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:50.717894 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-059a4893-5be6-4934-8299-757935c005f1 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:45:50.749103 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-059a4893-5be6-4934-8299-757935c005f1 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929204 Aug 18 20:45:50.749848 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Aug 18 20:45:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:45:53.147271 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:45:53.148221 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-f5c9a921-fb93-4a0f-a7a5-d2d3fa17b30b None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 18 20:45:53.148803 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:45:53.598438 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-3520893e-9e86-4b86-95e9-0c9558d076c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "disk": 1}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:45:53.621736 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:45:53.621736 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: warnings.warn(msg) Aug 18 20:45:53.706587 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-3520893e-9e86-4b86-95e9-0c9558d076c7 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.550974 Aug 18 20:45:53.707624 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:45:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:45:53.925996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-65eff455-6c52-45ea-9bd1-3c0b9595ed15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:45:53.930379 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:45:53.930379 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: warnings.warn(msg) Aug 18 20:45:53.951457 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_api:SELECT=3 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:53.953238 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_cell0:SELECT=3 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:53.953683 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_cell1:SELECT=3 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:53.955265 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:45:54.044592 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-65eff455-6c52-45ea-9bd1-3c0b9595ed15 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.328243 Aug 18 20:45:54.045186 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Aug 18 20:45:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:45:56.435194 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-3520893e-9e86-4b86-95e9-0c9558d076c7 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:45:56.436254 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-3520893e-9e86-4b86-95e9-0c9558d076c7 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 18 20:45:56.436651 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:45:57.128470 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-cd54066f-2c8d-4a76-b505-0feaff7b0248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "id": "d1", "disk": 5, "rxtx_factor": 1.0}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:45:57.148030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:45:57.148030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: warnings.warn(msg) Aug 18 20:45:57.254740 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-cd54066f-2c8d-4a76-b505-0feaff7b0248 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.811660 Aug 18 20:45:57.255773 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:45:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:45:57.267411 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-527c5ca6-6a5b-43ce-ac38-5020b262ebd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:45:57.270553 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:45:57.270553 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: warnings.warn(msg) Aug 18 20:45:57.368456 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-527c5ca6-6a5b-43ce-ac38-5020b262ebd4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104666 Aug 18 20:45:57.369459 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Aug 18 20:45:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:45:59.738863 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-cd54066f-2c8d-4a76-b505-0feaff7b0248 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:45:59.739911 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-cd54066f-2c8d-4a76-b505-0feaff7b0248 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 18 20:45:59.740305 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:00.153490 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-16b8213d-329c-4289-b80c-15a9f2b75269 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:00.229970 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-16b8213d-329c-4289-b80c-15a9f2b75269 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483368 Aug 18 20:46:00.231066 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:45:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:46:00.243283 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-9f2155cf-0b65-4577-98da-5f5f884d7086 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:00.330742 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-9f2155cf-0b65-4577-98da-5f5f884d7086 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091016 Aug 18 20:46:00.331563 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Aug 18 20:46:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:46:02.745429 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-16b8213d-329c-4289-b80c-15a9f2b75269 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:02.746513 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-16b8213d-329c-4289-b80c-15a9f2b75269 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 18 20:46:02.746916 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:03.283922 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-c7d394bf-4074-4a0b-aef3-367cb2039d32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:03.363324 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-c7d394bf-4074-4a0b-aef3-367cb2039d32 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.608648 Aug 18 20:46:03.364385 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:46:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:46:03.377117 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-50c6f46e-e9b8-423e-80a3-472754c04933 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:03.447176 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-50c6f46e-e9b8-423e-80a3-472754c04933 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073719 Aug 18 20:46:03.448035 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Aug 18 20:46:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:46:05.872622 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-c7d394bf-4074-4a0b-aef3-367cb2039d32 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:05.874314 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-c7d394bf-4074-4a0b-aef3-367cb2039d32 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Aug 18 20:46:05.874732 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:06.346855 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-a2287160-da31-4e5c-815e-b03290c2aea3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:06.449085 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-a2287160-da31-4e5c-815e-b03290c2aea3 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.566875 Aug 18 20:46:06.450099 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:46:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 20:46:06.464903 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-3ee8f84b-69d5-4bdd-98ad-2c353d174141 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:06.537409 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-3ee8f84b-69d5-4bdd-98ad-2c353d174141 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078957 Aug 18 20:46:06.538186 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Thu Aug 18 20:46:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:46:08.969775 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-a2287160-da31-4e5c-815e-b03290c2aea3 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:08.971398 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-a2287160-da31-4e5c-815e-b03290c2aea3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Aug 18 20:46:08.971816 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:09.417115 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-ebe9793f-a8fd-456e-85fd-da9220c39d56 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:09.441958 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-ebe9793f-a8fd-456e-85fd-da9220c39d56 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463736 Aug 18 20:46:09.442508 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Aug 18 20:46:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:46:11.893276 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-a2287160-da31-4e5c-815e-b03290c2aea3 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:11.894567 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-a2287160-da31-4e5c-815e-b03290c2aea3 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Aug 18 20:46:11.895422 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:46:12.369470 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-f8f0dff5-5c2c-4302-87ba-be56b739ec00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:12.428337 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-f8f0dff5-5c2c-4302-87ba-be56b739ec00 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.524465 Aug 18 20:46:12.429094 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:46:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 20:46:12.444494 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-a739433a-cbf7-4fe7-9929-c7a1042991ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:12.521327 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-a739433a-cbf7-4fe7-9929-c7a1042991ac admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081493 Aug 18 20:46:12.522087 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Aug 18 20:46:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:46:14.916596 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-f8f0dff5-5c2c-4302-87ba-be56b739ec00 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:14.917616 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-f8f0dff5-5c2c-4302-87ba-be56b739ec00 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 18 20:46:14.918058 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:15.341701 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-d46be28a-d2bb-40ec-9773-ee588d1b7bcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:15.419114 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-d46be28a-d2bb-40ec-9773-ee588d1b7bcf admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.494875 Aug 18 20:46:15.419705 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:46:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:46:15.431740 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-53cd9ba1-b2a0-475c-9037-eae598ce0d52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:15.498555 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-53cd9ba1-b2a0-475c-9037-eae598ce0d52 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070421 Aug 18 20:46:15.499163 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Aug 18 20:46:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:46:17.966486 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-d46be28a-d2bb-40ec-9773-ee588d1b7bcf admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:17.967638 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-d46be28a-d2bb-40ec-9773-ee588d1b7bcf admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 18 20:46:17.968318 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:18.376341 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-be0dfc9b-c1e3-45e6-a918-817e1b87759b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "id": "3", "name": "m1.medium"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:18.459340 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-be0dfc9b-c1e3-45e6-a918-817e1b87759b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.484490 Aug 18 20:46:18.460584 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:46:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 20:46:18.473502 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-a4584489-d360-4d98-b778-f11961144504 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:18.554684 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-a4584489-d360-4d98-b778-f11961144504 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085061 Aug 18 20:46:18.555402 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Aug 18 20:46:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:46:21.032663 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-be0dfc9b-c1e3-45e6-a918-817e1b87759b admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:21.034301 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-be0dfc9b-c1e3-45e6-a918-817e1b87759b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002399 Aug 18 20:46:21.035125 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:21.542457 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-4e6fa073-734d-4065-8d55-8cb127e6c93c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "disk": 80, "swap": 0, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:21.549753 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:21.705122 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-4e6fa073-734d-4065-8d55-8cb127e6c93c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.661978 Aug 18 20:46:21.705922 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:46:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:46:21.730074 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-b42fdc86-9c81-4fce-81b0-5b0cdb5f90ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:21.834812 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-b42fdc86-9c81-4fce-81b0-5b0cdb5f90ab admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108270 Aug 18 20:46:21.835682 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Aug 18 20:46:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:46:24.232792 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-4e6fa073-734d-4065-8d55-8cb127e6c93c admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:24.234474 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-4e6fa073-734d-4065-8d55-8cb127e6c93c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Aug 18 20:46:24.235324 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:24.695048 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-77d059fe-d002-4f9a-8479-7621d3899012 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:24.762566 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-77d059fe-d002-4f9a-8479-7621d3899012 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.520968 Aug 18 20:46:24.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Thu Aug 18 20:46:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 20:46:24.775823 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-1ce65681-3afc-400b-8cc1-05c8dbd75d8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:24.846112 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-1ce65681-3afc-400b-8cc1-05c8dbd75d8d admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074145 Aug 18 20:46:24.859390 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Thu Aug 18 20:46:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:46:44.540049 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-77d059fe-d002-4f9a-8479-7621d3899012 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:44.541676 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-77d059fe-d002-4f9a-8479-7621d3899012 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 18 20:46:44.542083 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:46:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:44.933614 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-d754caa7-fe37-4ecc-a4f3-ecdd41c052a6 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:44.952484 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-d754caa7-fe37-4ecc-a4f3-ecdd41c052a6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404202 Aug 18 20:46:44.953072 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Aug 18 20:46:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:46:46.013185 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-77d059fe-d002-4f9a-8479-7621d3899012 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:46.014225 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-77d059fe-d002-4f9a-8479-7621d3899012 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 18 20:46:46.014620 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:46.557832 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-d2c08856-0876-48a6-b227-a323b12d5fd7 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:46.563830 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.wsgi [None req-d2c08856-0876-48a6-b227-a323b12d5fd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-d2c08856-0876-48a6-b227-a323b12d5fd7 admin admin] Request method failure captured: Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Accept: application/json Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Accept-Encoding: gzip, deflate Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Connection: keep-alive Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Content-Length: 0 Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Host: 10.222.0.62 Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Openstack-Api-Version: compute 2.90 Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Openstack-System-Scope: None Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: User-Agent: python-novaclient Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Auth-Token: gAAAAABi_qU1ycQBDJ_JABKfCSl5meR1YVJo8n-_KMdg7rAYVyjsmMycQtQL-SroZO_dQZlH3WUvk7f6Ch73krCb6vo3MGMqIirE61lx9iO_mizbaHQQrgzuw9ysRuRY1YINvMXxktZ6rJEUNYf2whFruOUGtWl2w19VgaDJHZxx6v6LCqm1MGc Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Domain-Id: None Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Domain-Name: None Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Identity-Status: Confirmed Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Is-Admin-Project: True Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Domain-Id: default Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Domain-Name: Default Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Name: admin Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Role: reader,member,admin Aug 18 20:46:46.567045 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Roles: reader,member,admin Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant: admin Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant-Name: admin Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User: admin Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Domain-Id: default Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Domain-Name: Default Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Id: 2526f2a72f3a412d8bafb65717ad2b43 Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Name: admin Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: method: > Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: exception: Flavor 42 could not be found. Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: action_args: {'id': '42'} Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:46:46.568758 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:46.569817 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.571273 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-d2c08856-0876-48a6-b227-a323b12d5fd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:46:46.573171 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-d2c08856-0876-48a6-b227-a323b12d5fd7 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.415561 Aug 18 20:46:46.573171 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Aug 18 20:46:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:46.578973 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-f98409d7-3374-45bb-8ff2-b030a0d8556b admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:46.583011 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:46:46.601566 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-f98409d7-3374-45bb-8ff2-b030a0d8556b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026129 Aug 18 20:46:46.602122 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Aug 18 20:46:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:46:46.612406 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-51c9a620-a6fb-4528-b882-e9b80675b1ba admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:46.637158 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-51c9a620-a6fb-4528-b882-e9b80675b1ba admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028307 Aug 18 20:46:46.637721 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Aug 18 20:46:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:46:46.648088 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-b8ca3b9c-fb44-4437-b3ae-1209e82b1785 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:46.654076 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.wsgi [None req-b8ca3b9c-fb44-4437-b3ae-1209e82b1785 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-b8ca3b9c-fb44-4437-b3ae-1209e82b1785 admin admin] Request method failure captured: Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Accept: application/json Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Accept-Encoding: gzip, deflate Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Connection: keep-alive Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Content-Length: 0 Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Host: 10.222.0.62 Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Openstack-Api-Version: compute 2.90 Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Openstack-System-Scope: None Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: User-Agent: python-novaclient Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Auth-Token: gAAAAABi_qU1ycQBDJ_JABKfCSl5meR1YVJo8n-_KMdg7rAYVyjsmMycQtQL-SroZO_dQZlH3WUvk7f6Ch73krCb6vo3MGMqIirE61lx9iO_mizbaHQQrgzuw9ysRuRY1YINvMXxktZ6rJEUNYf2whFruOUGtWl2w19VgaDJHZxx6v6LCqm1MGc Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Domain-Id: None Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Domain-Name: None Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Identity-Status: Confirmed Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Is-Admin-Project: True Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Domain-Id: default Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Domain-Name: Default Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Name: admin Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Role: reader,member,admin Aug 18 20:46:46.657368 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Roles: reader,member,admin Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant: admin Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant-Name: admin Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User: admin Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Domain-Id: default Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Domain-Name: Default Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Id: 2526f2a72f3a412d8bafb65717ad2b43 Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Name: admin Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: method: > Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: exception: Flavor 42 could not be found. Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: action_args: {'id': '42'} Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:46:46.663576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:46.664707 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:46.665761 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-b8ca3b9c-fb44-4437-b3ae-1209e82b1785 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:46:46.666767 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-b8ca3b9c-fb44-4437-b3ae-1209e82b1785 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015098 Aug 18 20:46:46.666767 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Aug 18 20:46:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:47.646340 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-51c9a620-a6fb-4528-b882-e9b80675b1ba admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:47.647349 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-51c9a620-a6fb-4528-b882-e9b80675b1ba admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002091 Aug 18 20:46:47.647788 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:48.177239 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-bcf52fab-64a4-4420-8843-808f645f73a3 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:48.183086 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.wsgi [None req-bcf52fab-64a4-4420-8843-808f645f73a3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-bcf52fab-64a4-4420-8843-808f645f73a3 admin admin] Request method failure captured: Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Accept: application/json Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Accept-Encoding: gzip, deflate Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Connection: keep-alive Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Content-Length: 0 Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Host: 10.222.0.62 Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Openstack-Api-Version: compute 2.90 Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Openstack-System-Scope: None Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: User-Agent: python-novaclient Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Auth-Token: gAAAAABi_qU3xt4eQPjSwepd99Y7zCIu1cWz2VH2BoRiT62EZmzU8MIq2-Y3C1Ixt3Y0YeQ-GJkENOl8Rw-D9SVW_a7xed15ZlnJ68Z29ruLAplLNLRS2y-d25nZ5BAD89HbaTwTdJnC--JOaH1bIbuqARsLG0N9WBkS08edoMRT1K-yRoig91c Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Domain-Id: None Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Domain-Name: None Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Identity-Status: Confirmed Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Is-Admin-Project: True Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Domain-Id: default Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Domain-Name: Default Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Name: admin Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Role: reader,member,admin Aug 18 20:46:48.184621 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Roles: reader,member,admin Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant: admin Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant-Name: admin Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User: admin Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Domain-Id: default Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Domain-Name: Default Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Id: 2526f2a72f3a412d8bafb65717ad2b43 Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Name: admin Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: method: > Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: exception: Flavor 84 could not be found. Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: action_args: {'id': '84'} Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:46:48.186275 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:48.188210 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.189614 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-bcf52fab-64a4-4420-8843-808f645f73a3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:46:48.190894 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-bcf52fab-64a4-4420-8843-808f645f73a3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400622 Aug 18 20:46:48.190894 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Aug 18 20:46:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:48.195976 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-e7a3a927-a864-4f1b-a836-22055c241705 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:48.212312 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-e7a3a927-a864-4f1b-a836-22055c241705 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019849 Aug 18 20:46:48.213289 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Aug 18 20:46:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:46:48.226169 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-90c6c303-ff18-488d-b21a-58799761126b admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:48.243014 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-90c6c303-ff18-488d-b21a-58799761126b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020813 Aug 18 20:46:48.243593 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Aug 18 20:46:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:46:48.253630 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-2bf79a10-76ac-4bf8-8430-a4eb3e97a27c admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:48.259702 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.wsgi [None req-2bf79a10-76ac-4bf8-8430-a4eb3e97a27c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-2bf79a10-76ac-4bf8-8430-a4eb3e97a27c admin admin] Request method failure captured: Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Accept: application/json Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Accept-Encoding: gzip, deflate Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Connection: keep-alive Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Content-Length: 0 Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Host: 10.222.0.62 Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Openstack-Api-Version: compute 2.90 Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Openstack-System-Scope: None Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: User-Agent: python-novaclient Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Auth-Token: gAAAAABi_qU3xt4eQPjSwepd99Y7zCIu1cWz2VH2BoRiT62EZmzU8MIq2-Y3C1Ixt3Y0YeQ-GJkENOl8Rw-D9SVW_a7xed15ZlnJ68Z29ruLAplLNLRS2y-d25nZ5BAD89HbaTwTdJnC--JOaH1bIbuqARsLG0N9WBkS08edoMRT1K-yRoig91c Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Domain-Id: None Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Domain-Name: None Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Identity-Status: Confirmed Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Is-Admin-Project: True Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Domain-Id: default Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Domain-Name: Default Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Name: admin Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Role: reader,member,admin Aug 18 20:46:48.261765 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Roles: reader,member,admin Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant: admin Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant-Name: admin Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User: admin Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Domain-Id: default Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Domain-Name: Default Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Id: 2526f2a72f3a412d8bafb65717ad2b43 Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Name: admin Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: method: > Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: exception: Flavor 84 could not be found. Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: action_args: {'id': '84'} Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:46:48.263382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:48.264368 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:48.265781 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-2bf79a10-76ac-4bf8-8430-a4eb3e97a27c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:46:48.267055 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-2bf79a10-76ac-4bf8-8430-a4eb3e97a27c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013125 Aug 18 20:46:48.267055 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Thu Aug 18 20:46:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:49.241299 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-90c6c303-ff18-488d-b21a-58799761126b admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:49.242319 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-90c6c303-ff18-488d-b21a-58799761126b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 18 20:46:49.242862 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:49.774451 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-f26aacc1-e375-47d4-8308-b70329c52254 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:49.780707 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.wsgi [None req-f26aacc1-e375-47d4-8308-b70329c52254 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-f26aacc1-e375-47d4-8308-b70329c52254 admin admin] Request method failure captured: Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Accept: application/json Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Accept-Encoding: gzip, deflate Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Connection: keep-alive Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Content-Length: 0 Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Host: 10.222.0.62 Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Openstack-Api-Version: compute 2.90 Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Openstack-System-Scope: None Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: User-Agent: python-novaclient Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Auth-Token: gAAAAABi_qU51eV3SL_8edz9TC441AemKOBbqQJr3Z9R25hfNbbTU2sBP8tG5vtW7h0Y-tXXAY7vgm2JqUe-HBGshhIlWy5z8_xoLE0VIidZTvhfdXrbht_IiOGa98Rs8H1ftBox7MJbzJxgZDGRsy4EY94btNjm0dJ4rjS8HvxdF5cA7Ce8H_I Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Domain-Id: None Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Domain-Name: None Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Identity-Status: Confirmed Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Is-Admin-Project: True Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Domain-Id: default Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Domain-Name: Default Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Project-Name: admin Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Role: reader,member,admin Aug 18 20:46:49.782186 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Roles: reader,member,admin Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant: admin Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-Tenant-Name: admin Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User: admin Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Domain-Id: default Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Domain-Name: Default Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Id: 2526f2a72f3a412d8bafb65717ad2b43 Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: X-User-Name: admin Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: method: > Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: exception: Flavor 451 could not be found. Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: action_args: {'id': '451'} Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:46:49.783831 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:49.784796 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.786097 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-f26aacc1-e375-47d4-8308-b70329c52254 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112816) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:46:49.787394 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-f26aacc1-e375-47d4-8308-b70329c52254 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.401685 Aug 18 20:46:49.787394 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Aug 18 20:46:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 20:46:49.793812 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-12a951e3-1d82-450a-8e36-cbf397d41bfc admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:49.808433 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-12a951e3-1d82-450a-8e36-cbf397d41bfc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018717 Aug 18 20:46:49.808958 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Aug 18 20:46:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:46:49.818480 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:49.833514 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018526 Aug 18 20:46:49.834091 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Thu Aug 18 20:46:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:46:49.844140 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-361caebb-8f0a-4896-90f8-6c687cf020dc admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:49.849501 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.wsgi [None req-361caebb-8f0a-4896-90f8-6c687cf020dc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-361caebb-8f0a-4896-90f8-6c687cf020dc admin admin] Request method failure captured: Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Accept: application/json Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Accept-Encoding: gzip, deflate Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Connection: keep-alive Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Content-Length: 0 Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Host: 10.222.0.62 Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Openstack-Api-Version: compute 2.90 Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Openstack-System-Scope: None Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: User-Agent: python-novaclient Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Auth-Token: gAAAAABi_qU51eV3SL_8edz9TC441AemKOBbqQJr3Z9R25hfNbbTU2sBP8tG5vtW7h0Y-tXXAY7vgm2JqUe-HBGshhIlWy5z8_xoLE0VIidZTvhfdXrbht_IiOGa98Rs8H1ftBox7MJbzJxgZDGRsy4EY94btNjm0dJ4rjS8HvxdF5cA7Ce8H_I Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Domain-Id: None Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Domain-Name: None Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Identity-Status: Confirmed Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Is-Admin-Project: True Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Domain-Id: default Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Domain-Name: Default Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Project-Name: admin Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Role: reader,member,admin Aug 18 20:46:49.850996 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Roles: reader,member,admin Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e6113ebebf7b4a1a9829f6a6a5263233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant: admin Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant-Id: e6113ebebf7b4a1a9829f6a6a5263233 Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-Tenant-Name: admin Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User: admin Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Domain-Id: default Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Domain-Name: Default Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Id: 2526f2a72f3a412d8bafb65717ad2b43 Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: X-User-Name: admin Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: method: > Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: exception: Flavor 451 could not be found. Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: action_args: {'id': '451'} Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:46:49.852631 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:49.854030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: ERROR nova.api.openstack.wsgi Aug 18 20:46:49.855101 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-361caebb-8f0a-4896-90f8-6c687cf020dc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:46:49.856145 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-361caebb-8f0a-4896-90f8-6c687cf020dc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011917 Aug 18 20:46:49.856145 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Aug 18 20:46:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 18 20:46:50.833468 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:50.834570 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Aug 18 20:46:50.834979 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:51.377610 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-cefc92bb-36d2-495b-9f53-5fca70b843c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:51.469933 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-cefc92bb-36d2-495b-9f53-5fca70b843c3 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.493874 Aug 18 20:46:51.470498 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Aug 18 20:46:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 20:46:52.459794 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:52.460829 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 18 20:46:52.461240 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:52.999105 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-770f0098-d1d8-4d7a-935c-c2aae099bed8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:53.234896 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-770f0098-d1d8-4d7a-935c-c2aae099bed8 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.631064 Aug 18 20:46:53.235477 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Aug 18 20:46:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:46:54.214384 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:54.215422 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 18 20:46:54.215820 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:54.759108 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-07ff8974-43ec-4b07-86de-54f259c3aaac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:54.835576 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-07ff8974-43ec-4b07-86de-54f259c3aaac admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.468768 Aug 18 20:46:54.836132 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Aug 18 20:46:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:46:55.813627 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:55.814637 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 18 20:46:55.815039 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:56.356259 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-114409f0-bfab-4019-a638-58f2a1d586f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:46:56.436067 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-114409f0-bfab-4019-a638-58f2a1d586f9 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.483204 Aug 18 20:46:56.436628 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Thu Aug 18 20:46:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:46:57.418461 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:57.419491 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 18 20:46:57.419887 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:46:57.949810 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-b719928d-f1a2-48b4-ad88-0c219f3397ae admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:46:57.970636 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-b719928d-f1a2-48b4-ad88-0c219f3397ae admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409300 Aug 18 20:46:57.971180 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Thu Aug 18 20:46:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:47:52.163270 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:47:52.164959 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-10d818b8-967c-40f8-bd70-303a4341d280 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Aug 18 20:47:52.165382 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Thu Aug 18 20:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:47:52.185388 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:52.589971 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-721d35b3-8ccf-47e7-95d9-8ff92774417f admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:47:52.610750 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-721d35b3-8ccf-47e7-95d9-8ff92774417f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.438554 Aug 18 20:47:52.611299 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Thu Aug 18 20:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:47:52.631975 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG dbcounter [-] [112816] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112816) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:47:52.635793 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-ad0b3abb-fbd6-45b2-84eb-5c5cf04f67bd admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:47:52.643492 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-ad0b3abb-fbd6-45b2-84eb-5c5cf04f67bd admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012928 Aug 18 20:47:52.644203 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Thu Aug 18 20:47:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:47:52.656512 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-ea0352d9-6b6e-46ad-b277-ddaffb29f74c admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:47:52.664737 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-ea0352d9-6b6e-46ad-b277-ddaffb29f74c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011796 Aug 18 20:47:52.665256 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Thu Aug 18 20:47:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:47:52.677225 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:47:52.685732 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012372 Aug 18 20:47:52.686265 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Thu Aug 18 20:47:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:47:52.698606 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-574722ed-d899-42c3-b7ca-e2db589f28fd admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:47:52.706422 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-574722ed-d899-42c3-b7ca-e2db589f28fd admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011727 Aug 18 20:47:52.706946 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Thu Aug 18 20:47:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:51:05.112391 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:05.113408 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 18 20:51:05.113843 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:51:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:51:05.270270 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_api:SELECT=6 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:05.436299 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:05.438655 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:51:05.438655 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: warnings.warn(msg) Aug 18 20:51:05.439792 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:05.440263 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:05.440690 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:05.441394 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:05.441870 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:05.442276 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:05.476462 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-599f2c25-ce9d-4bd5-8318-8187f98d6730 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.211375 Aug 18 20:51:05.477030 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Aug 18 20:51:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:51:06.317030 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:06.318052 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 18 20:51:06.318451 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:51:06.514036 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:06.516445 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:51:06.516445 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: warnings.warn(msg) Aug 18 20:51:06.517587 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:06.518017 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:06.518439 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:06.519425 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:06.519871 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:06.520282 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:06.540229 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-9593c5a7-0e95-4545-ac75-9e1486da3153 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078528 Aug 18 20:51:06.540723 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Aug 18 20:51:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:51:17.772987 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:17.774058 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 18 20:51:17.774512 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:51:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:51:17.918054 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_cell0:SELECT=4 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:17.918910 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_cell1:SELECT=4 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:17.919566 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG dbcounter [-] [112815] Writing DB stats nova_api:SELECT=8 {{(pid=112815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:17.967908 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:17.970374 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:51:17.970374 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: warnings.warn(msg) Aug 18 20:51:17.971507 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:17.971990 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:17.972444 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:17.973161 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:17.973608 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:17.974061 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:17.999382 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-204e667d-5e13-43e4-a3e8-638017ef2e36 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086962 Aug 18 20:51:17.999989 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Aug 18 20:51:17 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:51:18.825861 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: DEBUG nova.api.openstack.wsgi [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] Calling method '>' {{(pid=112816) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:18.826873 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: INFO nova.api.openstack.requestlog [None req-ad6d9d2b-9972-4c97-a801-25f39801439b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 18 20:51:18.827279 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: [pid: 112816|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Thu Aug 18 20:51:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:51:19.020200 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG nova.api.openstack.wsgi [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] Calling method '>' {{(pid=112815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:51:19.022554 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 20:51:19.022554 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: warnings.warn(msg) Aug 18 20:51:19.023716 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:19.024196 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:19.024651 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:19.025601 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:51:19.025812 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:51:19.026235 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: DEBUG oslo_concurrency.lockutils [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:51:19.048365 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: INFO nova.api.openstack.requestlog [None req-c19ed049-890a-44f5-baa6-70f32f3929ac admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081040 Aug 18 20:51:19.048853 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: [pid: 112815|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Thu Aug 18 20:51:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:52:18.042122 dv-cinder-852654-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 20:52:18.043559 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: Thu Aug 18 20:52:18 2022 - graceful shutdown triggered... Aug 18 20:52:18.044146 dv-cinder-852654-2-iscsi devstack@n-api.service[112815]: Gracefully killing worker 1 (pid: 112815)... Aug 18 20:52:18.044503 dv-cinder-852654-2-iscsi devstack@n-api.service[112816]: Gracefully killing worker 2 (pid: 112816)... Aug 18 20:52:19.043446 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: worker 1 buried after 1 seconds Aug 18 20:52:19.043446 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: worker 2 buried after 1 seconds Aug 18 20:52:19.044429 dv-cinder-852654-2-iscsi devstack@n-api.service[112814]: goodbye to uWSGI. Aug 18 20:52:19.045240 dv-cinder-852654-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 20:52:19.046054 dv-cinder-852654-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 20:52:19.049349 dv-cinder-852654-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 20:52:19.062765 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 20:52:19.066926 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 20:52:19 2022] *** Aug 18 20:52:19.067505 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 20:52:19.067737 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 20:52:19.067923 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: nodename: dv-cinder-852654-2-iscsi Aug 18 20:52:19.068113 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: machine: x86_64 Aug 18 20:52:19.068312 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: clock source: unix Aug 18 20:52:19.068502 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: pcre jit disabled Aug 18 20:52:19.068690 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: detected number of CPU cores: 4 Aug 18 20:52:19.068866 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: current working directory: / Aug 18 20:52:19.069044 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: detected binary path: /usr/bin/uwsgi-core Aug 18 20:52:19.069232 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: your processes number limit is 47680 Aug 18 20:52:19.069412 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: your memory page size is 4096 bytes Aug 18 20:52:19.069590 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: detected max file descriptor number: 2048 Aug 18 20:52:19.069789 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: lock engine: pthread robust mutexes Aug 18 20:52:19.070237 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: thunder lock: enabled Aug 18 20:52:19.071198 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 20:52:19.071520 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 20:52:19.113969 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: Python main interpreter initialized at 0x5576653d59c0 Aug 18 20:52:19.113969 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: python threads support enabled Aug 18 20:52:19.113969 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: your server socket listen backlog is limited to 100 connections Aug 18 20:52:19.113969 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: your mercy for graceful operations on workers is 90 seconds Aug 18 20:52:19.114611 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 20:52:19.114611 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: *** Operational MODE: preforking *** Aug 18 20:52:19.114877 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: *** uWSGI is running in multiple interpreter mode *** Aug 18 20:52:19.114877 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: spawned uWSGI master process (pid: 127921) Aug 18 20:52:19.115094 dv-cinder-852654-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 20:52:19.119413 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: spawned uWSGI worker 1 (pid: 127936, cores: 1) Aug 18 20:52:19.119413 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: spawned uWSGI worker 2 (pid: 127937, cores: 1) Aug 18 20:52:19.119413 dv-cinder-852654-2-iscsi devstack@n-api.service[127921]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 20:52:19.831743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 20:52:19.865975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 20:52:21.021816 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:52:21.021816 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: from cryptography.utils import int_from_bytes Aug 18 20:52:21.022532 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:52:21.022532 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: from cryptography.utils import int_from_bytes Aug 18 20:52:21.050288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:52:21.050288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: from cryptography.utils import int_from_bytes Aug 18 20:52:21.050863 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:52:21.050863 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: from cryptography.utils import int_from_bytes Aug 18 20:52:23.565218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:52:23.566015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:52:23.566015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:52:23.566412 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:52:23.566668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:52:23.567077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.567427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.567753 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.568070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.568577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.569060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.569555 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.569896 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.570241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.571062 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.571404 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.571741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-2-iscsi {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.572071 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.572556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.572872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.573198 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.573511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.573835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.574146 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.574653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.575109 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.575446 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.575766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.576181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.576418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.576747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.577053 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.577366 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.577702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.578010 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.578422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-2-iscsi {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.578747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.579065 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.579466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.579899 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.580220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.580535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.580857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.581199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.581512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.581839 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.582158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.582482 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.582807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.583111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.583458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.583770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.584093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.584436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.584755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.585007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.585314 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.585640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.586019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.586855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.587112 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.587464 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.587795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.588122 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.588435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.588747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.589060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.589370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.589680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.589991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.590305 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.590616 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.591019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.591341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.591889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.592153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.592480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.592893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.593149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.593465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.593808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.594129 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.594443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.594765 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.595091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.595423 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.595736 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.596046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.596368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.596707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.597017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.597487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.597997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.598502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.599026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.599575 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.599892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.600213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.600521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.600837 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.601151 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.601462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.601997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.602317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.602637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.602955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.603271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.603614 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.603956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.604283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.604600 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.604913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.605227 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.605540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.605870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.606185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.606495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.607046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.607331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.607740 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.608076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.608387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.608700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.609025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.609341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.609655 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.609984 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.611405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.611405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.611405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.611405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.611822 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.611822 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.612100 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.612598 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.613085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.613423 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.613757 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.614077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.614388 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.614701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.615024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.615590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.615941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.616295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.616617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.616959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.617339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.617667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.617988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.618311 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.618645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.618963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.619284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.619653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.619984 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.620311 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.620660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.620976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.621299 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.621623 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.621939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.622257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.622593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.623086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.623255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.623615 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.623959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.624302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.624607 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.624937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.625253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.625569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.625887 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.626219 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.626559 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.626874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.627819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.627819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.628701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.628701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.628701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.629433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.629433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.629433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.630126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.630126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.631921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.631921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.631921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.631921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.631921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.631921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.634266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.634266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.634266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.634266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.634266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.635605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.635605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.635605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.635605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.635605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.637746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.637746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.637746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.637746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.637746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.637746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.637746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.639185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.639185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.639185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.639185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.639805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.639805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.640772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.640772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.640772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.640772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.644891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.647149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.649750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.651230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.651230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.651230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.651230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.651230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.651230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.651230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.655535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.655535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.655535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.655535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.655535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.655535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.659064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.660997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.663313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.668029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.669847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.669847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.669847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.669847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.669847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.669847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.671056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.671056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.671056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.671056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.672048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.672048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.672048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.674051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.674051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.674051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.674051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.674051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.674051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.675918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.675918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.675918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.675918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.675918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.675918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.677197 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.677197 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.677197 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.677197 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.677197 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.678346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.678346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.678346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.678925 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.679542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.679542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.687994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.689875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.691557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.694667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.696941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.698477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.700313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.701759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.704332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.705652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:52:23.706526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.706798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:52:23.707164 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.707164 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.707514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:52:23.707514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:52:23.707953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.707953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.708183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:52:23.708363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.708487 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.708600 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.708719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.708953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.709143 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.709275 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.709415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.709548 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.709548 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.709839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.709976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.710154 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.710339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.710531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.710672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.710794 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.710936 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.711599 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.711720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.712902 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.713163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.713918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.714544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.714787 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852654-2-iscsi {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.715278 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.715565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.715782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.715944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.716107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.716305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.716811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.716977 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.717271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.717443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.717637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.717844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.718079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.718399 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.718620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.718620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.719069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.719346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.719652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.719921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.720226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.720476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.720708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.720940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.721195 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.721444 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.721697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.721916 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.722076 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.722258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.722430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.722593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.722777 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.722940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.723139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.723323 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.723542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.723714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.723714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.724007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852654-2-iscsi {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.724219 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.724741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.724971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.725895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.726144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.727169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.727479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.727659 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.727818 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.727971 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.728123 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.728285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.728515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.728684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.728851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.729026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.729188 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.729658 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.729844 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.730018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.730180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.730333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.730486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.730638 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.730800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.730952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.731104 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.731268 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.731617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.731822 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.731995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.732150 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.732310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.732474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.732627 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.732791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.732944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.733103 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.733255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.733407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.733570 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.733734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.733886 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.734038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.734196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.734907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.735078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.735249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.735249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.735589 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.735874 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.736039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.736219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.736373 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.736526 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.736679 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.736954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.737660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.737660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.737989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.738226 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.738381 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.738581 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.738750 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.738917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.739077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.739077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.739434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.739595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.739769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.739928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.740080 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.740238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.740398 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.740559 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.740728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.740890 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.741070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.741231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.741390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.741550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.741720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.741720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.742011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.742191 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.742687 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.742850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.743015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.743272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.743509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.743689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.743844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.744011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.744166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.744166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.744719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.745076 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.745237 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.745407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.745562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.745668 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.745756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.746054 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.746161 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.746267 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.746422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.746522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.746657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.746779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.746917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.748129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.748276 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.748402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.748659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.748792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.748920 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.749033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.749152 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.749273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.749385 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.749527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.749745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.749880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.750002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.750125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.750236 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.750355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.750481 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.750593 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.750711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.750824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.750934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.751044 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.751166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.751293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.751447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.751604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.751680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.751765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.751845 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.751923 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.751999 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.752077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.752146 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.752229 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.752302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.752370 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.752445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.752522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.752592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.752675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.752752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.752823 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.752892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.752969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.753040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.753107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.753107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.753238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.753317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.753395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.753477 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.753571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.753643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.753721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.754196 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.754318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.754437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.754550 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.754685 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.754816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.754954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.755264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.755405 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.755536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.755651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.755651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.755874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.755993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.755993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.756230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.756480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.756610 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.756726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.756838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.756958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.757070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.757288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.757429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.757637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.757637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.758579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.758579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.758579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.758579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.758579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.759174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.759294 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.759431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.759599 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.759849 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.759980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.760104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.760217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.760329 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.760450 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.760564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.760674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.760848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.760968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.761096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:52:23.761218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.761338 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.761465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.761605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.761719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.761719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.761950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762300 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762672 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762785 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.762896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763016 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763251 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763572 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.763951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.764072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.764192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.764700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.764838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.764959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.765087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.765451 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.765587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.765702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.765702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.765930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.766058 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.766174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.766286 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.766398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.766661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.766792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.766914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.768991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.769161 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.769292 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.769406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.769538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.769662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.769792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.770018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.770272 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.770409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.770540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.770664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.770778 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.770899 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.771936 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772406 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772520 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772870 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.772981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.773100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.773220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.773342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.773508 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.773673 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.773796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.774407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.774521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.774654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.774801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.774914 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.775034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.775147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.775258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.775716 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.775839 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.775961 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.776085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.776200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.776319 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.776442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.776562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.776694 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.776945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.777916 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.778030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.778141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.778259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.778390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.778676 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.779161 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.779320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.779664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.779791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.779910 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.780041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.780277 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.780400 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.780513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.780636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.780758 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.780893 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781008 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781231 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781593 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.781929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.782041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.782183 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.782319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.782432 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.782610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.782800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.783002 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.783199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.784030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.784677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.784893 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.785023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.785137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.785707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.785962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.785962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.786189 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.786312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.786435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.786560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.786560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.786792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.786792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.787160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.787289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.787509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.787657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.787779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.787779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.787997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.788121 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.788235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.788235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.788453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.788566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.788821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.789018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.789404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.789535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.789650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.789775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.789896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.790962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791563 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.791916 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.792028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.792153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.792273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.792386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.792496 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.792606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.793078 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.793284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.793483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.793691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.793892 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.794082 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.794277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.794489 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.794682 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.794879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.795070 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.795282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.795602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.796025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.796429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.796634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.796634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.797017 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.797214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.797487 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.797617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.797731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.797850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.797978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798102 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798102 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798324 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798444 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798444 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798663 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.798806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.799216 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.799533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.799533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.799792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.799913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.799913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.800139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.800252 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.800380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.800526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.800526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.800879 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801242 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801594 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.801947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802530 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.802889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.803021 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.803667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.803809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.803945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.804068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.804183 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.804304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.804418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.804537 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.804659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.805307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.805307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.805527 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.805648 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.805770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.805918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.806150 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.806269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.806411 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.806676 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.806796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.806796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.807027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808222 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808461 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.808928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.809071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.809377 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.809497 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.809762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.809908 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.810066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.810192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.810305 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.810417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.810543 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.810666 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.810919 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.811050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.811164 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.811286 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.811434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.811564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.811700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.811859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812004 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812146 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812563 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.812959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.813106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.813268 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.813536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.813672 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.813811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.813979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.814130 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.814263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.814413 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.814584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.814727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.814867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.815008 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.815141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.815353 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.815353 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.815653 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.815787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.815927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.816084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.816339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.816474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.816619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.816924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817602 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.817877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.818334 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.818486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.818631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.818772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.818913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.819076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.819222 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.819637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.819781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.819781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.820154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.821600 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.821749 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.821896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.822030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.822161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.822775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.822917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823912 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823996 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.823996 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824862 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.824962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825056 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825056 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.825927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.826172 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.826599 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.826708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.826796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.826796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.827026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.827159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.827694 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.827818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.827908 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.827993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.828967 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829430 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829537 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829730 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.829916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.830330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.830418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.830512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.830608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.830695 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.830833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.830932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831415 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831535 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831787 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.831980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.832073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.832159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.832762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.832866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833014 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833453 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833547 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.833961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834331 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834331 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834331 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834589 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834844 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.834986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835251 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835492 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835738 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.835977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.836586 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.836711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.836850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.836850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.837011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.837097 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.837180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.837645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.837755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.837844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.837929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.838981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839074 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839533 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839631 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839778 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.839966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.840060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.840170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.840491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.840592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.840678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.840842 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.840937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841023 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841190 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841676 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841868 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.841963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842416 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842602 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842698 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842884 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.842979 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.843065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.843157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.843250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.843502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.843610 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.843817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.843914 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.844125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.844229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.844406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127936) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:52:23.844518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.844732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.845106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.845505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.845645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.845947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.846257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.846567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.846901 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.847217 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.847643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.847886 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.848193 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.848548 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.848875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.849292 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.849549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.849873 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.850202 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.850645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.850838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.851160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.851507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.852922 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.852922 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.853266 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.853423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.853696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.853943 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.854259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.854578 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.854905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.855276 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.855605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.855916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.856288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.856554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.856871 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.857186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.857516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.857872 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.858158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.858713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.858880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.859086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.859456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.859749 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.860091 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.860382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.860776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.861144 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.861346 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.861663 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.861974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.862289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.862604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.863053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.863610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.863919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.864080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.864551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.864716 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.864927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.865249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.865559 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.865986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.866304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.866620 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.866938 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.868078 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.868297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.868469 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.868747 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.869058 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.869370 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.869681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.870008 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.870320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.870647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.871087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.871661 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.871840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.872142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.872465 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.872780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.873110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.873436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.873765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.874079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.874399 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.874713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.875044 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.875385 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.875720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.876043 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.876355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.876684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.877011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.877335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.877662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.878092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.878419 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.878737 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.879069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.879433 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.879751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.880063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.880380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.880692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.881112 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.881690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.881690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.881988 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.882234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.882234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.883682 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.883857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.884200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.884381 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.884725 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.885050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.885379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.885708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.886115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.886343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.886689 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.886967 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.887277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.887657 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.888011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.888509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.888793 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.889136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.889713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.889885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.890106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.890441 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.890765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.891273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.891592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.891860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.892171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.892639 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.892921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.893105 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.893692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.894010 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.894343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.894622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.894930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.895257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.895603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.895932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.896267 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.896550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.896863 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.897169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.897519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.897826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.898163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.898507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.898838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.899163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.899513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.899831 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.900149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.900513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.900792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.901111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.901514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.901734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.902051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.902382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.902962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.903713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.903713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.904027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.904256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.904579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.904898 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.905218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.905536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.905853 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.906172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.906512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.906842 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.907176 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.907548 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.907877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.908199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.908518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.908934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.909201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.909462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO dbcounter [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Registered counter for database nova_api Aug 18 20:52:23.909622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.909825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.910171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.910456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.910777 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.911094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.911588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.911771 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.912065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.912390 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.912709 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.913030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.913349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.913684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.914032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.914778 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.915106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.915453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.915776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.916358 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.916684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.917026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.917362 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.917711 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.918040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.918367 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.918723 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.919203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.919814 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.919814 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.920112 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.920289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.920721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.920935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.921249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.921738 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.921913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.922468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.922832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.923162 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.923529 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.923863 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.924189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.924506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.924867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.925147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.925528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.926151 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.926491 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.926822 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.927174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.927536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.927757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.928085 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.928564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.928799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.929024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.929436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.929650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.930478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.930999 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.931235 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.931454 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.931919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.932096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.932391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.932547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_db.sqlalchemy.engines [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:23.932727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.933014 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.933340 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.933658 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.933970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.934285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.934593 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.935012 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.935233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.935706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.936039 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.936356 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.936789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.937110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.937575 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.937874 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.938168 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.938765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.939156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.939939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.939939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.940305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.940470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writer thread running {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:23.940649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.940797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.941194 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.941391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.941710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.942031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.942353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.942673 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.942990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.943307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.943656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.943972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.944289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.944605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.944921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.945236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.946120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.946438 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.946764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.947124 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.947478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.947807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.948133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.948457 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.948774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.949092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.949408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.949726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.950049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.950386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.950706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.951018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.951488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.951815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.952144 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.952475 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.952796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.953126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.953454 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.953770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.954100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.954418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.954755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.955104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.955460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.955795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.956106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.956418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.956729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.957045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.957369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.957683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.957991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.958298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.958612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.958919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.959228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.959571 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.959880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.960194 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.960519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.960827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.961165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.962185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.962185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.962185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.962690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.962690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.962993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.963283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.963636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.963945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.964291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.964631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.964954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.966231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.966231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.966231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.966697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.966697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.966994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.967325 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.968591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.968591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.968591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.968591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.969089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.969229 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.969522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.969843 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.970178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.970513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.970825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.971156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.971517 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.971844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.972167 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.972490 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.972826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.973141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.973458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.973772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.974093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.974407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.974727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.975043 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.975356 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.975696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.976016 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.976349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.976708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.977022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.977353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.977686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.978039 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.978357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.979271 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.979271 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.979599 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.979745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.979975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:52:23.980224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127937) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:52:24.000788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.context [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81167f5b-f1a0-4b68-bbb4-89664992faba(cell1) {{(pid=127936) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 20:52:24.004917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:52:24.005412 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:52:24.007006 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:52:24.007800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:52:24.008950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:52:24.010969 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:52:24.013036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO dbcounter [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Registered counter for database nova_cell0 Aug 18 20:52:24.017220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO dbcounter [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Registered counter for database nova_cell1 Aug 18 20:52:24.026702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_db.sqlalchemy.engines [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:24.027959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_db.sqlalchemy.engines [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:24.034679 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writer thread running {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:24.036022 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writer thread running {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:24.043981 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO dbcounter [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Registered counter for database nova_api Aug 18 20:52:24.067705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_db.sqlalchemy.engines [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:24.076896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writer thread running {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:24.142435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.context [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),81167f5b-f1a0-4b68-bbb4-89664992faba(cell1) {{(pid=127937) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 20:52:24.146881 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:52:24.147384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:52:24.148980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:52:24.149759 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:52:24.150211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:52:24.154121 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:52:24.156271 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO dbcounter [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Registered counter for database nova_cell0 Aug 18 20:52:24.160864 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO dbcounter [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Registered counter for database nova_cell1 Aug 18 20:52:24.176022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_db.sqlalchemy.engines [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:24.177018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writer thread running {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:24.181781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_db.sqlalchemy.engines [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:24.212929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO dbcounter [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Registered counter for database nova_cell0 Aug 18 20:52:24.219787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_db.sqlalchemy.engines [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127936) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:24.224338 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writer thread running {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:24.327781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writer thread running {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:24.336524 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO dbcounter [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Registered counter for database nova_cell0 Aug 18 20:52:24.343179 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_db.sqlalchemy.engines [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127937) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:24.352820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writer thread running {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:24.548362 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: WARNING keystonemiddleware.auth_token [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:52:24.556236 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: WARNING keystonemiddleware.auth_token [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:52:24.689521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: WARNING keystonemiddleware.auth_token [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:52:24.697563 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: WARNING keystonemiddleware.auth_token [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:52:24.897204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: WARNING keystonemiddleware.auth_token [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:52:24.903713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: WARNING keystonemiddleware.auth_token [None req-07e66b87-84b5-4a09-a3af-e68c116c534e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:52:24.909399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576653d59c0 pid: 127936 (default app) Aug 18 20:52:25.044808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: WARNING keystonemiddleware.auth_token [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 20:52:25.050796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: WARNING keystonemiddleware.auth_token [None req-f477f88d-4c00-4744-bc0c-0495536028ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 20:52:25.056134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576653d59c0 pid: 127937 (default app) Aug 18 20:53:04.785158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.786403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.788150 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.789359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.185700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.188265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.189415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.190853 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.784392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-56a3cf4c-8ad0-4125-99c1-6b9b0a7b8d23 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Action: 'create', calling method: .version_select at 0x7f8b5c4764c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1631634935", "metadata": {"Type": "work"}}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-56a3cf4c-8ad0-4125-99c1-6b9b0a7b8d23 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Request method failure captured: Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 122 Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qawYKNLqrdfZ5DH5RvGXkzXmx-S-eE_kkyBD3-Qmv0DgDs8EJ9WdCYrNvgIlMvmPnNt3o2_zRAbyJxAJhbugSlxZFtGePCKe-MEIsWEQ5qC9CZudPxet0N8w4SXjogOgT1nJ9cu4FK15nQOB-vsEaFw7nnZQ1yBSSVB1dS9hUQlNKQ Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:53:06.797033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df334d744de34d76814c568aab5fb8b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cc91169fe4d142948323130019f5e8e9 Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1631634935", "metadata": {"Type": "work"}}} Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 20:53:06.798700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1631634935', 'metadata': {'Type': 'work'}}}} Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise error Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:53:06.799755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 20:53:06.801439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 20:53:06.805613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 20:53:06.805613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.805613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-56a3cf4c-8ad0-4125-99c1-6b9b0a7b8d23 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:53:06.805613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-56a3cf4c-8ad0-4125-99c1-6b9b0a7b8d23 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.031755 Aug 18 20:53:06.805613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Aug 18 20:53:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2036 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 20:53:06.820171 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e64eb2cb-8f42-48d3-95a8-dd72e16da3eb tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Action: 'create', calling method: .version_select at 0x7f8b5c476550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1689523334", "metadata": {"Type": "work"}}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e64eb2cb-8f42-48d3-95a8-dd72e16da3eb tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Request method failure captured: Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 120 Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qawYKNLqrdfZ5DH5RvGXkzXmx-S-eE_kkyBD3-Qmv0DgDs8EJ9WdCYrNvgIlMvmPnNt3o2_zRAbyJxAJhbugSlxZFtGePCKe-MEIsWEQ5qC9CZudPxet0N8w4SXjogOgT1nJ9cu4FK15nQOB-vsEaFw7nnZQ1yBSSVB1dS9hUQlNKQ Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:53:06.826593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df334d744de34d76814c568aab5fb8b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cc91169fe4d142948323130019f5e8e9 Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1689523334", "metadata": {"Type": "work"}}} Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 20:53:06.839567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1689523334', 'metadata': {'Type': 'work'}}}} Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise error Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi '0' Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:53:06.841099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 20:53:06.842838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 20:53:06.844509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 20:53:06.844509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.844509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e64eb2cb-8f42-48d3-95a8-dd72e16da3eb tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:53:06.844509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e64eb2cb-8f42-48d3-95a8-dd72e16da3eb tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016401 Aug 18 20:53:06.844509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 2/2] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Aug 18 20:53:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 20:53:06.846603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3ae899db-74d9-42c4-ac6a-7c95cbeaff51 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Action: 'create', calling method: .version_select at 0x7f8b5c3330d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-669959098", "metadata": {"Type": "work"}}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3ae899db-74d9-42c4-ac6a-7c95cbeaff51 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Request method failure captured: Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 118 Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qawYKNLqrdfZ5DH5RvGXkzXmx-S-eE_kkyBD3-Qmv0DgDs8EJ9WdCYrNvgIlMvmPnNt3o2_zRAbyJxAJhbugSlxZFtGePCKe-MEIsWEQ5qC9CZudPxet0N8w4SXjogOgT1nJ9cu4FK15nQOB-vsEaFw7nnZQ1yBSSVB1dS9hUQlNKQ Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:53:06.850579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df334d744de34d76814c568aab5fb8b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cc91169fe4d142948323130019f5e8e9 Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-669959098", "metadata": {"Type": "work"}}} Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 20:53:06.854054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-669959098', 'metadata': {'Type': 'work'}}}} Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise error Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi '' Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:53:06.855851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 20:53:06.858542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 20:53:06.860390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 20:53:06.860390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:06.860390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3ae899db-74d9-42c4-ac6a-7c95cbeaff51 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:53:06.860390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3ae899db-74d9-42c4-ac6a-7c95cbeaff51 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009423 Aug 18 20:53:06.860390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 3/3] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Aug 18 20:53:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 20:53:06.864656 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1a5884b3-c9f2-461e-b61a-ff3a06abc312 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Calling method '.version_select at 0x7f8b5c333a60>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:07.653533 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-dc0f10c6-5bc3-4e2f-a8ed-e1f241aacd3b tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Action: 'create', calling method: .version_select at 0x7f8b5c3f7550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-314819459", "metadata": {"Type": "work"}}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:08.154003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-1a5884b3-c9f2-461e-b61a-ff3a06abc312 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] HTTP exception thrown: Volume tempest-invalid-1844627731 could not be found. Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1a5884b3-c9f2-461e-b61a-ff3a06abc312 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Request method failure captured: Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1844627731 HTTP/1.1 Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qawYKNLqrdfZ5DH5RvGXkzXmx-S-eE_kkyBD3-Qmv0DgDs8EJ9WdCYrNvgIlMvmPnNt3o2_zRAbyJxAJhbugSlxZFtGePCKe-MEIsWEQ5qC9CZudPxet0N8w4SXjogOgT1nJ9cu4FK15nQOB-vsEaFw7nnZQ1yBSSVB1dS9hUQlNKQ Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:53:08.160381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df334d744de34d76814c568aab5fb8b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cc91169fe4d142948323130019f5e8e9 Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Volume tempest-invalid-1844627731 could not be found. Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'tempest-invalid-1844627731'} Aug 18 20:53:08.163201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1844627731 could not be found. (HTTP 404) (Request-ID: req-229b7f43-5880-4f1d-9bfe-c52f11658cc9) Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.172229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 20:53:08.174729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1844627731 could not be found. Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:53:08.177032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1844627731 could not be found. Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1844627731 could not be found. Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1a5884b3-c9f2-461e-b61a-ff3a06abc312 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Returning 404 to user: Volume tempest-invalid-1844627731 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1a5884b3-c9f2-461e-b61a-ff3a06abc312 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1844627731" status: 404 len: 99 microversion: 2.1 time: 1.303178 Aug 18 20:53:08.184003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 4/4] 10.222.0.62 () {58 vars in 1218 bytes} [Thu Aug 18 20:53:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1844627731 => generated 99 bytes in 1305 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 20:53:08.186435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d8f4e33d-7cbd-4ad7-ad40-689567079c73 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011262 Aug 18 20:53:08.186435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 5/5] 10.222.0.62 () {58 vars in 1140 bytes} [Thu Aug 18 20:53:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 20:53:08.207856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-da937492-40b3-44f8-aef8-596c6168705c tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013697 Aug 18 20:53:08.210835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 6/6] 10.222.0.62 () {58 vars in 1137 bytes} [Thu Aug 18 20:53:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 20:53:08.242499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3f756a96-e110-4393-ae39-15e6a40f9f4c tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Calling method '.version_select at 0x7f8b5c2633a0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:08.433612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-3f756a96-e110-4393-ae39-15e6a40f9f4c tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] HTTP exception thrown: Volume 6d20154f-351c-4e4c-97a7-68d855c82912 could not be found. Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3f756a96-e110-4393-ae39-15e6a40f9f4c tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Request method failure captured: Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/os-volumes/6d20154f-351c-4e4c-97a7-68d855c82912 HTTP/1.1 Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qawYKNLqrdfZ5DH5RvGXkzXmx-S-eE_kkyBD3-Qmv0DgDs8EJ9WdCYrNvgIlMvmPnNt3o2_zRAbyJxAJhbugSlxZFtGePCKe-MEIsWEQ5qC9CZudPxet0N8w4SXjogOgT1nJ9cu4FK15nQOB-vsEaFw7nnZQ1yBSSVB1dS9hUQlNKQ Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:53:08.438544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df334d744de34d76814c568aab5fb8b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cc91169fe4d142948323130019f5e8e9 Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Volume 6d20154f-351c-4e4c-97a7-68d855c82912 could not be found. Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '6d20154f-351c-4e4c-97a7-68d855c82912'} Aug 18 20:53:08.445019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d20154f-351c-4e4c-97a7-68d855c82912 could not be found. (HTTP 404) (Request-ID: req-41a1c82b-7055-4265-9fe7-bc7395b01e39) Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.446823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 20:53:08.451144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d20154f-351c-4e4c-97a7-68d855c82912 could not be found. Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 20:53:08.458021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d20154f-351c-4e4c-97a7-68d855c82912 could not be found. Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d20154f-351c-4e4c-97a7-68d855c82912 could not be found. Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3f756a96-e110-4393-ae39-15e6a40f9f4c tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Returning 404 to user: Volume 6d20154f-351c-4e4c-97a7-68d855c82912 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3f756a96-e110-4393-ae39-15e6a40f9f4c tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/6d20154f-351c-4e4c-97a7-68d855c82912" status: 404 len: 109 microversion: 2.1 time: 0.229204 Aug 18 20:53:08.467177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 7/7] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 20:53:08 2022] DELETE /compute/v2.1/os-volumes/6d20154f-351c-4e4c-97a7-68d855c82912 => generated 109 bytes in 238 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:08.483987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e4afab59-02c7-4eb4-bf84-7c49c49e8e71 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Calling method '.version_select at 0x7f8b5c2b2ca0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:08.598469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-e4afab59-02c7-4eb4-bf84-7c49c49e8e71 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] HTTP exception thrown: Volume 64d86609-bacf-4c43-baf9-1017a5f71e46 could not be found. Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e4afab59-02c7-4eb4-bf84-7c49c49e8e71 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Request method failure captured: Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/os-volumes/64d86609-bacf-4c43-baf9-1017a5f71e46 HTTP/1.1 Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qawYKNLqrdfZ5DH5RvGXkzXmx-S-eE_kkyBD3-Qmv0DgDs8EJ9WdCYrNvgIlMvmPnNt3o2_zRAbyJxAJhbugSlxZFtGePCKe-MEIsWEQ5qC9CZudPxet0N8w4SXjogOgT1nJ9cu4FK15nQOB-vsEaFw7nnZQ1yBSSVB1dS9hUQlNKQ Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:53:08.604710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_df334d744de34d76814c568aab5fb8b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/df334d744de34d76814c568aab5fb8b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: df334d744de34d76814c568aab5fb8b5 Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesNegativeTest-900113193 Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cc91169fe4d142948323130019f5e8e9 Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesNegativeTest-900113193-project Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Volume 64d86609-bacf-4c43-baf9-1017a5f71e46 could not be found. Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '64d86609-bacf-4c43-baf9-1017a5f71e46'} Aug 18 20:53:08.607687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64d86609-bacf-4c43-baf9-1017a5f71e46 could not be found. (HTTP 404) (Request-ID: req-dbac7adc-04de-4000-b0c1-ba1c2cb28a0f) Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.609496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 20:53:08.611649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64d86609-bacf-4c43-baf9-1017a5f71e46 could not be found. Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 20:53:08.613861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64d86609-bacf-4c43-baf9-1017a5f71e46 could not be found. Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64d86609-bacf-4c43-baf9-1017a5f71e46 could not be found. Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e4afab59-02c7-4eb4-bf84-7c49c49e8e71 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] Returning 404 to user: Volume 64d86609-bacf-4c43-baf9-1017a5f71e46 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:53:08.624541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e4afab59-02c7-4eb4-bf84-7c49c49e8e71 tempest-VolumesNegativeTest-900113193 tempest-VolumesNegativeTest-900113193-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/64d86609-bacf-4c43-baf9-1017a5f71e46" status: 404 len: 109 microversion: 2.1 time: 0.136671 Aug 18 20:53:08.637377 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 8/8] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 20:53:08 2022] GET /compute/v2.1/os-volumes/64d86609-bacf-4c43-baf9-1017a5f71e46 => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:10.815135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-dc0f10c6-5bc3-4e2f-a8ed-e1f241aacd3b tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.644994 Aug 18 20:53:10.819541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 1/9] 10.222.0.62 () {60 vars in 1156 bytes} [Thu Aug 18 20:53:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4652 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 20:53:10.844223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f10c4b87-e6dd-4549-88b4-d9e09b5ec994 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Calling method '.version_select at 0x7f8b5c333ca0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:11.228773 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f10c4b87-e6dd-4549-88b4-d9e09b5ec994 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5" status: 200 len: 352 microversion: 2.1 time: 0.398081 Aug 18 20:53:11.229336 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 9/10] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 20:53:10 2022] GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5 => generated 352 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:53:12.250189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-94bd42d1-6384-42ba-803e-4bb32e35cfa6 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Calling method '.version_select at 0x7f8b5c2cb430>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:12.382115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-94bd42d1-6384-42ba-803e-4bb32e35cfa6 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5" status: 200 len: 353 microversion: 2.1 time: 0.143099 Aug 18 20:53:12.392062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 2/11] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 20:53:12 2022] GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:53:12.400306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-480d9e69-1bb3-4650-b83a-9783f8a9c5d3 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Calling method '.version_select at 0x7f8b5c263940>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:12.699727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-480d9e69-1bb3-4650-b83a-9783f8a9c5d3 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5" status: 200 len: 353 microversion: 2.1 time: 0.305662 Aug 18 20:53:12.712722 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 10/12] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 20:53:12 2022] GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5 => generated 353 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:53:12.727894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4ad1ed51-4475-4d19-bc95-783ae99ef2f9 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Calling method '.version_select at 0x7f8b5c2cbaf0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:13.227745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4ad1ed51-4475-4d19-bc95-783ae99ef2f9 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5" status: 202 len: 0 microversion: 2.1 time: 0.506934 Aug 18 20:53:13.229187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 3/13] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 20:53:12 2022] DELETE /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5 => generated 0 bytes in 510 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 20:53:13.250046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-75fd0490-c3fe-4c1a-9c1c-177549ff1d30 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Calling method '.version_select at 0x7f8b5c263040>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:13.437203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-75fd0490-c3fe-4c1a-9c1c-177549ff1d30 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5" status: 200 len: 352 microversion: 2.1 time: 0.200398 Aug 18 20:53:13.438686 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 11/14] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 20:53:13 2022] GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5 => generated 352 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:53:14.455529 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-49290427-20f7-436c-b514-aee8c5831e31 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Calling method '.version_select at 0x7f8b5c2e41f0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:14.510653 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-49290427-20f7-436c-b514-aee8c5831e31 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] HTTP exception thrown: Volume 2255722c-d0a9-4670-bec7-9dcf1be443d5 could not be found. Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-49290427-20f7-436c-b514-aee8c5831e31 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Request method failure captured: Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5 HTTP/1.1 Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qay5_TZIjWGeIlcgHs40WCROZyMEm-vRrJVz-14FEZW1om6mfmuS7-87MHsUUqWk2kjezKbVESFe8cklNcHDkqBlAHaAyLWCkaaYFoI8QKWaGs_d7MGDbKqzLCh0NWapnm3d3VyIewXJUtJ-OpNvnPgtBdkd9U0SO8hyk98fOe3Bew Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4a8a7951b0d34c5e8e399b13c5424f2d Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-VolumesGetTestJSON-836858004 Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 20:53:14.519459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4a8a7951b0d34c5e8e399b13c5424f2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a8a7951b0d34c5e8e399b13c5424f2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4a8a7951b0d34c5e8e399b13c5424f2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4a8a7951b0d34c5e8e399b13c5424f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-VolumesGetTestJSON-836858004 Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4a8a7951b0d34c5e8e399b13c5424f2d Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-VolumesGetTestJSON-836858004 Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-VolumesGetTestJSON-836858004-project Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 9ea7f97f6fdd4977bb85c578a2bd7c21 Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-VolumesGetTestJSON-836858004-project Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Volume 2255722c-d0a9-4670-bec7-9dcf1be443d5 could not be found. Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '2255722c-d0a9-4670-bec7-9dcf1be443d5'} Aug 18 20:53:14.522332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2255722c-d0a9-4670-bec7-9dcf1be443d5 could not be found. (HTTP 404) (Request-ID: req-16198d8c-0bcb-41ab-8952-c2205d4a9166) Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:14.524835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 20:53:14.537420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2255722c-d0a9-4670-bec7-9dcf1be443d5 could not be found. Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 20:53:14.539455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2255722c-d0a9-4670-bec7-9dcf1be443d5 could not be found. Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2255722c-d0a9-4670-bec7-9dcf1be443d5 could not be found. Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-49290427-20f7-436c-b514-aee8c5831e31 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] Returning 404 to user: Volume 2255722c-d0a9-4670-bec7-9dcf1be443d5 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-49290427-20f7-436c-b514-aee8c5831e31 tempest-VolumesGetTestJSON-836858004 tempest-VolumesGetTestJSON-836858004-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5" status: 404 len: 109 microversion: 2.1 time: 0.082379 Aug 18 20:53:14.541474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 4/15] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 20:53:14 2022] GET /compute/v2.1/os-volumes/2255722c-d0a9-4670-bec7-9dcf1be443d5 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:53:26.670690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-871888690", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:26.831183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1833847349", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "networks": [{"uuid": "951b87d0-09fd-4bef-b5d6-09f4fa3efad6"}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:26.877035 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.network.neutron [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] validate_networks() for [('4c154e09-d159-4559-8961-a918c8fdec5a', None, None, None, None, None)] {{(pid=127936) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:53:27.055126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] validate_networks() for [('951b87d0-09fd-4bef-b5d6-09f4fa3efad6', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:53:28.443350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:53:28.443350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:53:28.443350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:53:28.444803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:53:28.445457 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:53:28.468554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:28.469431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:28.470110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:28.471135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:28.471900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:28.472514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:28.525244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Getting quotas for project 7a536708296847aeb7a88156d077da60. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:53:28.534650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Getting quotas for user 41b8a21b3d0747c68eda9f991d735772 and project 7a536708296847aeb7a88156d077da60. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:53:28.550669 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:53:28.555097 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:53:28.625201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Flavor limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:53:28.627282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Image limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:53:28.628535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Flavor pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:53:28.629624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Image pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:53:28.630758 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:53:28.671315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:28.672202 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:28.673392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:28.674843 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:28.675641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:28.676456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:28.728247 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for project 119af0f155d0477cbc4a15a054070278. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:53:28.738619 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for user 86c2b496a2c04a0094bf30111bf25669 and project 119af0f155d0477cbc4a15a054070278. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:53:28.760182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Going to run 1 instances... {{(pid=127936) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:53:28.766859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127936) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:53:28.906149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-757c06d3-4287-476c-8da5-611d63dfcfbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.407382 Aug 18 20:53:28.907656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 5/16] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 20:53:29.113258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b74d9b9b-4396-46ba-a085-6160419d5e2a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.763699 Aug 18 20:53:29.116290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 12/17] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:53:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:53:29.149741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-89633e21-302f-4225-8ee0-7196d09e1087 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:29.153027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-89633e21-302f-4225-8ee0-7196d09e1087 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:29.209113 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-55e1296a-6eab-4c7c-ab8b-60a57504fefe tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: .version_select at 0x7f8b5b9469d0>, body: {"keypair": {"name": "tempest-keypair-828167663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpLeNesNIcLY2aqAC6NEWi5bcM1jnRdXZaE7ePMzOBQXJwGTWgOxsekr+FLDo+Qrn2CFaaQ3HQYO9/7yV8beUdEqof6mOBayIuOHda1fi13Ing/1uYffOZqVUwDvJARSg=="}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:29.273499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-55e1296a-6eab-4c7c-ab8b-60a57504fefe tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:53:29.288131 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-55e1296a-6eab-4c7c-ab8b-60a57504fefe tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:53:29.517729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-55e1296a-6eab-4c7c-ab8b-60a57504fefe tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.603344 Aug 18 20:53:29.518869 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 6/18] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 20:53:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:53:29.526390 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a8a5beea-82ca-4a31-a8a7-7313038d6ea3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:29.527243 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a8a5beea-82ca-4a31-a8a7-7313038d6ea3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:29.778837 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-89633e21-302f-4225-8ee0-7196d09e1087 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:29.823108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a8a5beea-82ca-4a31-a8a7-7313038d6ea3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:29.878841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a8a5beea-82ca-4a31-a8a7-7313038d6ea3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1221 microversion: 2.1 time: 0.358800 Aug 18 20:53:29.884495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 7/19] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:29 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1221 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:29.891352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-89633e21-302f-4225-8ee0-7196d09e1087 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1215 microversion: 2.1 time: 0.771426 Aug 18 20:53:29.892449 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 13/20] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:29 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1215 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:30.285233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-549181270", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:30.421565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] validate_networks() for [('4c154e09-d159-4559-8961-a918c8fdec5a', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:53:30.935176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0f3c7c4d-caba-48ec-98d0-a9842ca52cbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:30.936080 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0f3c7c4d-caba-48ec-98d0-a9842ca52cbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:31.082834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0f3c7c4d-caba-48ec-98d0-a9842ca52cbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:31.092819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0f3c7c4d-caba-48ec-98d0-a9842ca52cbb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1215 microversion: 2.1 time: 0.160414 Aug 18 20:53:31.095135 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 14/21] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:30 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:31.729587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:53:31.730677 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:53:31.731325 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:53:31.731957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:53:31.732734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:53:31.763596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:31.763596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:31.763596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:31.763596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:31.764194 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:31.764194 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:31.806376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for project 119af0f155d0477cbc4a15a054070278. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:53:31.814320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for user 86c2b496a2c04a0094bf30111bf25669 and project 119af0f155d0477cbc4a15a054070278. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:53:31.855485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:53:31.864690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:53:32.073386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e43fde8c-5740-40e6-b681-db9b4967273b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.808553 Aug 18 20:53:32.075462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 8/22] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:53:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:53:32.096546 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cfc11b9c-5e25-4562-b889-c16dec373e49 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:32.097937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cfc11b9c-5e25-4562-b889-c16dec373e49 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:32.130925 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-15c37121-cbae-4af9-b92f-5feaf4d47875 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:32.131647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-15c37121-cbae-4af9-b92f-5feaf4d47875 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:32.295215 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cfc11b9c-5e25-4562-b889-c16dec373e49 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:32.308875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cfc11b9c-5e25-4562-b889-c16dec373e49 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1221 microversion: 2.1 time: 0.222407 Aug 18 20:53:32.309817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 15/23] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:32 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:32.431647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-15c37121-cbae-4af9-b92f-5feaf4d47875 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:32.451550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-15c37121-cbae-4af9-b92f-5feaf4d47875 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1215 microversion: 2.1 time: 0.325036 Aug 18 20:53:32.455627 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 9/24] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:32 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:33.356984 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-11a0b6c6-7dc0-4629-a903-bb52aeb5105a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:33.369463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-11a0b6c6-7dc0-4629-a903-bb52aeb5105a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:33.518498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:33.524213 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:33.572029 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:33.574254 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:33.584694 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:33.592946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:33.594477 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:33.596373 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:33.820398 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-11a0b6c6-7dc0-4629-a903-bb52aeb5105a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:33.860051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-11a0b6c6-7dc0-4629-a903-bb52aeb5105a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1221 microversion: 2.1 time: 0.511399 Aug 18 20:53:33.874042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 16/25] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:33 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1221 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:33.970115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:33.998830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a2767c96-73a6-4271-87cf-a999804ef0a4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1219 microversion: 2.1 time: 0.503425 Aug 18 20:53:34.000321 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 10/26] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:33 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1219 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:34.892024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:34.893117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:34.930635 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:34.931137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:34.931620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:34.932340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:34.942053 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:34.942524 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:35.023706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:35.024982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:35.038613 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:35.041513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:35.042323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:35.044430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:35.046591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:35.047888 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:35.281896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:35.297084 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0f475292-e0f8-4374-b379-6c5d4a6e5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1267 microversion: 2.1 time: 0.274186 Aug 18 20:53:35.297699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 11/27] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:35 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:35.438429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:35.466361 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-caa7cb37-55c0-466e-bace-b312aef3bbe9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1217 microversion: 2.1 time: 0.580671 Aug 18 20:53:35.467807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 17/28] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:34 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1217 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:36.322431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:36.323569 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:36.354163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:36.367065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:36.369486 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:36.390760 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:36.391875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:36.393164 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:36.494029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:36.496017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:36.511641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:36.514912 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:36.516944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:36.519281 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:36.523060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:36.525602 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:36.665422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:36.675236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-45af4501-9605-4e01-88cf-d217103c3534 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1285 microversion: 2.1 time: 0.359195 Aug 18 20:53:36.687879 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 12/29] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:36 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1285 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:37.320700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:37.354701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d9448418-9240-426e-9e08-a3dc596b756f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1291 microversion: 2.1 time: 0.869392 Aug 18 20:53:37.357823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 18/30] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:36 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1291 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:37.712715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:37.713354 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:37.727350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:37.729376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:37.730430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:37.733686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:37.734252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:37.734696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:37.952650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:37.977885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c9ad7f44-c63c-4780-85d4-ec47f220c3d2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1273 microversion: 2.1 time: 0.269694 Aug 18 20:53:37.979434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 13/31] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:37 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:38.394216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:38.399266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:38.425234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:38.425739 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:38.426196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:38.427482 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:38.428107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:38.428683 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:38.545080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-982647959", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c5039fe-c5ac-448f-a973-5b4f5015467c"}], "security_groups": [{"name": "tempest-securitygroup--435522011"}], "key_name": "tempest-keypair-828167663", "user_data": "}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:38.656535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:38.680943 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e7c99334-79e7-4bf3-9c61-f5af281d11cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1279 microversion: 2.1 time: 0.303545 Aug 18 20:53:38.684061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 19/32] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:38 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1279 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:39.023692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:39.024326 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:39.027988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:39.061570 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:39.062363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:39.065317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:39.074456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:39.075201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:39.075767 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:39.380676 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:39.392020 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6dd800c4-45aa-4c17-8e71-f1c2c954a4c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1273 microversion: 2.1 time: 0.371751 Aug 18 20:53:39.394826 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 20/33] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:39 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1273 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:39.594087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] validate_networks() for [('1c5039fe-c5ac-448f-a973-5b4f5015467c', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:53:39.718464 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:39.719274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:39.739994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:39.740903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:39.741590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:39.743087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:39.744306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:39.750013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:40.015078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:40.025515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-345d6778-4811-4b88-b1f8-3b9061f6389c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1279 microversion: 2.1 time: 0.314315 Aug 18 20:53:40.026870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 21/34] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:39 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1279 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:40.418625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:40.419420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:40.449486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:40.449486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:40.449486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:40.449486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:40.449792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:40.449792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:40.753441 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:53:40.757159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:53:40.757159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:53:40.757159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:53:40.757159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:53:40.790660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:40.793259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:40.794187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:40.800684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:40.800684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:40.800684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:40.890104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:53:40.932919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:53:40.965964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:53:40.972851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:53:41.233764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e7a7d1fc-56cf-47c4-a091-9e6aaea06e9c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.706181 Aug 18 20:53:41.233764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 14/35] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:53:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:53:41.250761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:41.253548 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:41.310082 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:41.317929 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:41.352565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:41.356900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:41.367013 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:41.372316 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:41.602226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:41.611406 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-136577d2-00a3-4fef-9364-457166bd4407 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1279 microversion: 2.1 time: 0.376233 Aug 18 20:53:41.616187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 15/36] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:41 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1279 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:41.631003 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c17bf558-1de7-48aa-95f6-921f08278101 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:41.631003 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c17bf558-1de7-48aa-95f6-921f08278101 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:41.929223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c17bf558-1de7-48aa-95f6-921f08278101 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:41.941645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c17bf558-1de7-48aa-95f6-921f08278101 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1240 microversion: 2.1 time: 0.323672 Aug 18 20:53:41.942719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 16/37] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:41 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1240 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:42.180789 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:42.209101 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-19c640b8-0a54-48dc-9a61-0e49c848bcfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 1.795384 Aug 18 20:53:42.211070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 22/38] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:40 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:42.643588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:42.644566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:42.658647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:42.659278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:42.659995 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:42.661333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:42.662250 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:42.663132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:42.980763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c05d9161-ce33-4815-8024-d497984961ec tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:42.986416 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c05d9161-ce33-4815-8024-d497984961ec tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:43.572975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c05d9161-ce33-4815-8024-d497984961ec tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:43.583936 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c05d9161-ce33-4815-8024-d497984961ec tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1240 microversion: 2.1 time: 0.621337 Aug 18 20:53:43.586577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 23/39] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:42 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1240 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:43.603966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:43.605002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:43.617260 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:43.618142 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:43.619183 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:43.620786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:43.623681 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:43.624475 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:43.990032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:44.006952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-30cd4e04-c839-45f5-a7b5-ff6f86dbd8b5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 1.372089 Aug 18 20:53:44.012164 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 17/40] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:42 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:44.371139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:44.433583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5d20bfeb-ba85-4af3-81bd-8c34f7be5563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.840522 Aug 18 20:53:44.436852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 24/41] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:43 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:44.611057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:44.612146 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:44.624923 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:44.624923 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:44.625428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:44.638702 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:44.639579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:44.640279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:44.849175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:44.878767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a4b0aa33-da43-431b-bd48-f71522c36e94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1292 microversion: 2.1 time: 0.270472 Aug 18 20:53:44.890287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 18/42] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:44 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1292 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:45.041126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:45.042230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:45.074809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:45.078250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:45.079111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:45.085615 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:45.086589 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:45.089756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:45.481079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:45.482230 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:45.491308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:45.492123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:45.492974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:45.494486 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:45.495632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:45.496687 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:45.547714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:45.571680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8c5d20e1-6fe2-436c-93fa-f6abb09e45f1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.538411 Aug 18 20:53:45.587938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 25/43] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:45 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:45.954729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:45.969438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:46.001059 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:46.003112 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:46.023397 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:46.024993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:46.025591 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:46.026234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:46.109555 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:46.121643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9ae28509-d452-4291-8d1e-d3e3b32ec77f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.645814 Aug 18 20:53:46.122733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 19/44] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:45 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:46.245645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:46.272556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4e60db41-1de1-4f3c-aa94-088a1733fc41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1300 microversion: 2.1 time: 0.344185 Aug 18 20:53:46.274380 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 26/45] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:45 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1300 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:46.609128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:46.610673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:46.618523 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:46.619426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:46.620116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:46.621072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:46.621734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:46.622374 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:46.712352 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df6d725b-6c0e-43f3-b240-99f9a739d63f", "tag": "f5399b38-95d8-4997-bf45-40f7f8ef7c71"}, {"name": "network-changed", "server_uuid": "629e5883-6808-4193-8639-e5461fc0ce76", "tag": "e19522c1-8141-425b-9590-25796bc4b274"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:46.743317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:46.744517 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:46.745256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:46.836447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Creating event network-changed:f5399b38-95d8-4997-bf45-40f7f8ef7c71 for instance df6d725b-6c0e-43f3-b240-99f9a739d63f on hv-cinder-85265 Aug 18 20:53:46.838619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Creating event network-changed:e19522c1-8141-425b-9590-25796bc4b274 for instance 629e5883-6808-4193-8639-e5461fc0ce76 on hv-cinder-85265 Aug 18 20:53:46.843648 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127937) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 20:53:46.847511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-6d33b72f-f42c-4011-b7d7-e99fccd22919 req-2a67f286-db61-4e7c-b1dc-63dba66156c5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127937) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 20:53:46.847511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:46.848985 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:46.850125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:46.851469 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:46.852242 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:46.852895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:46.869932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.compute.rpcapi [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 20:53:46.871498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] Releasing lock "compute-rpcapi-router" {{(pid=127937) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 20:53:46.883963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:46.893499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1a551e07-46d2-4afb-a572-12402cbe75dd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.289012 Aug 18 20:53:46.894425 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 27/46] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:46 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:46.898210 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-453b2b29-400d-44e1-a5d3-b573c4de9b18 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.575545 Aug 18 20:53:46.899964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 20/47] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:53:47.145439 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:47.146125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:47.152766 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.153259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.153697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.154408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.154863 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.155289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.295502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:47.306302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-35be6dd3-0aa9-43df-8a4d-6e160e132f47 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.165399 Aug 18 20:53:47.306891 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 21/48] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:47 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:47.311528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:47.312146 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:47.319766 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.320485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.320964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.321651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.322110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.327266 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.396560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:47.405178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a1f964fd-e78d-4d5f-a139-9b06ddde9720 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1300 microversion: 2.1 time: 0.097199 Aug 18 20:53:47.405767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 22/49] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:47 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1300 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:47.413953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-a2a8b7a7-30cd-466d-9f7d-796056fdb18e req-4422b79d-d1d1-4339-a306-9886d60a5b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc448b9-4ec7-434a-b395-d4a344b78179", "tag": "5fe340e0-9ebc-47a8-b2f9-dcc9d92c95b3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:53:47.428333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2a8b7a7-30cd-466d-9f7d-796056fdb18e req-4422b79d-d1d1-4339-a306-9886d60a5b27 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.429048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2a8b7a7-30cd-466d-9f7d-796056fdb18e req-4422b79d-d1d1-4339-a306-9886d60a5b27 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.430176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2a8b7a7-30cd-466d-9f7d-796056fdb18e req-4422b79d-d1d1-4339-a306-9886d60a5b27 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.451577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-a2a8b7a7-30cd-466d-9f7d-796056fdb18e req-4422b79d-d1d1-4339-a306-9886d60a5b27 service nova] Creating event network-changed:5fe340e0-9ebc-47a8-b2f9-dcc9d92c95b3 for instance 1cc448b9-4ec7-434a-b395-d4a344b78179 on hv-cinder-85265 Aug 18 20:53:47.452107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2a8b7a7-30cd-466d-9f7d-796056fdb18e req-4422b79d-d1d1-4339-a306-9886d60a5b27 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127936) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 20:53:47.452503 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2a8b7a7-30cd-466d-9f7d-796056fdb18e req-4422b79d-d1d1-4339-a306-9886d60a5b27 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127936) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 20:53:47.453787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.454253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.454680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.455418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.455870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.456285 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.467621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.compute.rpcapi [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 20:53:47.467621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127936) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 20:53:47.482618 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-db560e9e-06c0-4b1e-84a8-a7c1d2b447d5 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.419142 Aug 18 20:53:47.483247 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 28/50] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:53:47.927135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:47.927839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:47.934625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.935186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.935791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:47.936556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:47.937072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:47.937585 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:48.077215 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:48.085709 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f054f105-0d7d-41bc-b707-9c0cfb901e3d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.163263 Aug 18 20:53:48.086293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 23/51] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:47 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:48.328324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:48.329109 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:48.335822 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:48.336290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:48.347196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:48.347196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:48.347196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:48.347196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:48.433511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:48.438724 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:48.440067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.446587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:48.447524 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:48.448224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:48.449024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:48.449850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:48.450346 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:48.536727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:48.547428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b69d291e-4aa8-4db4-a707-6c5212b4c94c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1300 microversion: 2.1 time: 0.123426 Aug 18 20:53:48.556470 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 24/52] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:48 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:48.561299 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:48.570690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-47476990-750e-4f5d-99c0-12d99b6621bc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.246593 Aug 18 20:53:48.571286 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 29/53] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:48 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:49.107991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:49.108523 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:49.115277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:49.115833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:49.116264 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:49.117028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:49.117487 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:49.117907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:49.302821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:49.311809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bcaae7e0-f3f1-4b5f-abda-1ae749436029 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.208226 Aug 18 20:53:49.312395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 25/54] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:49 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:49.569799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:49.570429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:49.577005 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:49.577497 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:49.577942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:49.578671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:49.579130 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:49.579707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:49.595631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:49.596317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:49.603543 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:49.603880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:49.606736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:49.606736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:49.606736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:49.606736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:49.674761 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:49.687556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d6829cfc-ab54-4203-8d03-30dc512e3fd2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1300 microversion: 2.1 time: 0.121637 Aug 18 20:53:49.689565 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 30/55] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:49 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1300 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:49.836889 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:49.845911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d0b49032-d91b-4efd-8f4a-208eb08b059d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.255012 Aug 18 20:53:49.846604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 26/56] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:49 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:50.350540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:50.351758 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:50.380524 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:50.381875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:50.382839 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:50.384340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:50.385377 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:50.386415 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:50.581843 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:50.592206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a6131204-e20a-4949-ac4c-9ee65e1e8c1b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.251426 Aug 18 20:53:50.605484 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 31/57] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:50 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:50.728930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:50.728930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:50.739608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:50.740931 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:50.741849 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:50.743277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:50.744615 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:50.748635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:50.878019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:50.882577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.882916 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:50.890182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:50.898547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:50.898997 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-42564d6b-0132-4d79-b1c9-05ce1f3a41aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1300 microversion: 2.1 time: 0.187824 Aug 18 20:53:50.899843 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 27/58] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:50 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1300 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:50.900722 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:50.901520 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:50.903530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:50.904747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:50.906609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:51.244208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:51.255974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c2c9a7be-4f6f-4013-b5ba-04b3e4624fab tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.383555 Aug 18 20:53:51.257381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 32/59] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:50 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:51.625248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:51.631099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:51.667492 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:51.668858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:51.672194 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:51.675833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:51.681560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:51.690979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:51.939868 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:51.946972 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:51.954156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=28 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.980722 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:51.983953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:51.985255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:51.994085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:51.994085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:52.000460 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:52.681965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:52.724719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-304f714e-afed-4ca7-85c3-2abe374ac05a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1310 microversion: 2.1 time: 0.807145 Aug 18 20:53:52.725895 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 33/60] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:51 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1310 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:52.745620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:52.757831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:52.781423 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:52.782017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:52.782374 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:52.783102 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:52.783595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:52.784034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:52.891395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.021842 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:53.031529 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-afd7d13c-b199-4a71-b678-5a18db2f08f3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 1.421367 Aug 18 20:53:53.054427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 28/61] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:51 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:53.579002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=16 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.780512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:53.786681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:53.804730 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:53.806415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:53.809249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:53.811256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:53.812538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:53.818336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:54.078955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:54.097705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1decc6e8-2509-4cc4-8d67-f91ccf5649b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1298 microversion: 2.1 time: 0.321293 Aug 18 20:53:54.112104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 29/62] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:53 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1298 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:54.122456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:54.124357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:54.141179 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:54.144809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:54.146982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:54.148479 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:54.154422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:54.155338 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:54.160684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:54.178556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f697519f-5fcc-48f6-89d0-2d0c98039739 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 1.448951 Aug 18 20:53:54.181157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 34/63] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:52 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:54.550424 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:54.562702 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3565942c-8ad4-49ea-b58c-341af50b3d75 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.463118 Aug 18 20:53:54.563948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 30/64] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:54 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:55.124092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:55.124834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:55.139097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:55.140372 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:55.142953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:55.146795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:55.148003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:55.150226 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:55.210534 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:55.211301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:55.223402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:55.224187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:55.224757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:55.228810 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:55.229735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:55.230798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:55.442446 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:55.458968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-97cd3c3c-5dcc-4302-b297-66aff939c398 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.339921 Aug 18 20:53:55.462013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 35/65] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:55 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:55.506303 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:55.525166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-62c4e461-5be8-49af-a2dc-daff2b7ff976 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.320538 Aug 18 20:53:55.525763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 31/66] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:55 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:55.590196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:55.591187 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:55.607551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:55.607551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:55.607551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:55.607551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:55.608120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:55.608120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:55.812025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:55.825750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5326f56c-9b64-42a5-aadf-11ce3725b791 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.241770 Aug 18 20:53:55.826400 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 36/67] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:55 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:56.484626 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:56.487092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:56.499237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:56.500070 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:56.500735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:56.501656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:56.502766 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:56.503464 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:56.546027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:56.546799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:56.555019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.557176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:56.557673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:56.558165 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:56.558883 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:56.559485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:56.559980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:56.741564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:56.763952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-34925749-1b29-4e6d-8b7e-c508c921ff69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.283937 Aug 18 20:53:56.764832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 32/68] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:56 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:56.814932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:56.823291 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-64f6c868-73d0-4cdc-819d-774619256817 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.281886 Aug 18 20:53:56.827396 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 37/69] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:56 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:56.860378 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:56.861539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:56.870147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=8 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.872482 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:56.872984 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:56.874079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:56.874251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:56.874884 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:56.875313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:57.063895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:57.073348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0d4b5c56-03ba-439b-9726-567742d63b90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.226913 Aug 18 20:53:57.073907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 33/70] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:56 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:57.788399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:57.789528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:57.793168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.803391 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:57.804633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:57.805635 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:57.806940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:57.807834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:57.808814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:57.849683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:57.852285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:57.873471 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:57.874538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:57.875756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:57.877048 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:57.877787 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:57.878636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:58.059681 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:58.069196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b7046c5a-a76a-4f2a-bba2-599347166c49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.285889 Aug 18 20:53:58.069784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 38/71] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:57 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:58.110254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:58.110423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:58.111246 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:58.118503 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:58.119317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:58.120209 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:58.121259 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:58.121681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a1e034ee-297b-4481-8fa1-26d36c9888b2 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.278278 Aug 18 20:53:58.121776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:58.121854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 34/72] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:57 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:58.122085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:58.401298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:58.409351 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bf48bb18-0040-457b-a564-ee357cc776e0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.305880 Aug 18 20:53:58.409934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 39/73] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:58 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:59.107733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:59.109311 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:59.121893 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:59.122810 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:59.123999 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:59.125365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:59.126241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:59.128116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:59.148385 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:59.149751 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:59.164468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:59.164985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:59.169495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:59.170521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:59.171034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:59.171519 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:59.405563 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:59.416062 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4c688889-5c75-4d2a-905e-fca4c4d56730 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.274436 Aug 18 20:53:59.423323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:59.429979 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 40/74] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:59 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:59.435877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:53:59.436624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:53:59.439995 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cae95d0b-22be-4e1f-94b7-05bc7c5ef5df tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.340411 Aug 18 20:53:59.443480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 35/75] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:59 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:59.444740 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:59.445536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:59.445987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:59.446767 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:53:59.447427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:53:59.448067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:53:59.722295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:53:59.741066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-309b491b-65eb-495b-9879-1b93e235cf3f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.309497 Aug 18 20:53:59.759771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 41/76] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:53:59 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:00.445763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:00.445763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:00.450928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:00.452181 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:00.453416 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:00.455187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:00.455884 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:00.456665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:00.467559 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:00.472542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:00.491875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:00.492750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:00.493518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:00.494797 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:00.500710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:00.501646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:00.875941 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:00.901861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-be8ce33f-7b32-4cde-b3cd-3394da90f830 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.467234 Aug 18 20:54:00.907577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 36/77] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:00 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:00.923818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:00.929942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:00.933937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:00.934557 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:00.935106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:00.936232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:00.936880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:00.937418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:01.117301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:01.188006 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-55fb52bf-5368-46a5-9d55-d4433963d481 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.709664 Aug 18 20:54:01.188006 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 42/78] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:00 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:01.231262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:01.240368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-48274163-fce7-422d-bd1e-7371ae1f389d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.330023 Aug 18 20:54:01.240960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 37/79] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:00 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:01.550242 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-065d39ef-2cf5-4896-851a-e8c3b874c163 req-8dff77cb-31d3-4224-82f8-5927fd2c49f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81738bf-5d23-441d-8b75-e66cf5781acf", "tag": "815b310a-9ed7-4cf5-bc0c-e3c9a87a8824"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:01.604878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-065d39ef-2cf5-4896-851a-e8c3b874c163 req-8dff77cb-31d3-4224-82f8-5927fd2c49f6 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:01.607649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-065d39ef-2cf5-4896-851a-e8c3b874c163 req-8dff77cb-31d3-4224-82f8-5927fd2c49f6 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:01.610426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-065d39ef-2cf5-4896-851a-e8c3b874c163 req-8dff77cb-31d3-4224-82f8-5927fd2c49f6 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:01.648465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-065d39ef-2cf5-4896-851a-e8c3b874c163 req-8dff77cb-31d3-4224-82f8-5927fd2c49f6 service nova] Creating event network-changed:815b310a-9ed7-4cf5-bc0c-e3c9a87a8824 for instance a81738bf-5d23-441d-8b75-e66cf5781acf on hv-cinder-85265 Aug 18 20:54:01.666111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-065d39ef-2cf5-4896-851a-e8c3b874c163 req-8dff77cb-31d3-4224-82f8-5927fd2c49f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125697 Aug 18 20:54:01.669038 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 43/80] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:54:01.941213 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:01.942031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:01.949662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:01.950163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:01.950608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:01.952040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:01.952770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:01.953215 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:02.175481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:02.185005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ba809650-4f73-4d77-b260-2a156f84ffee tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.247793 Aug 18 20:54:02.185784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 38/81] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:01 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:02.221059 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:02.222038 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:02.257669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:02.257669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:02.257669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:02.257669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:02.258257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:02.258257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:02.265110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:02.265922 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:02.273662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:02.274140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:02.274513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:02.275599 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:02.276159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:02.276850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:02.495060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:02.509651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6c448251-3146-4882-9dd3-d1466219b6a2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.296049 Aug 18 20:54:02.510365 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 44/82] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:02 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:02.665903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:02.673975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b0f71022-15a5-458e-9387-3cff91271936 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.415592 Aug 18 20:54:02.674557 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 39/83] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:02 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:03.219551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:03.221228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:03.230272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:03.231513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:03.232268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:03.234594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:03.235156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:03.235709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:03.408361 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:03.420432 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b298c41a-1603-4aa8-a805-9d2da964fd8d tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.205017 Aug 18 20:54:03.463862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 45/84] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:03 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:03.549862 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:03.550562 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:03.556928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:03.557429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:03.557867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:03.558580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:03.559035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:03.559491 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:03.704078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:03.704804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:03.711725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:03.712228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:03.712673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:03.713386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:03.713842 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:03.714270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:03.729791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:03.742609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-47cfe51e-3dac-47f8-8b56-6c1f73923662 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.196270 Aug 18 20:54:03.743935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 40/85] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:03 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:03.878463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:03.886661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-664a0fce-6cc8-46fc-bf6c-f3ff68e02a53 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.188679 Aug 18 20:54:03.887238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 46/86] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:03 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:04.453556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:04.454432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:04.463488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:04.463488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:04.463488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:04.463488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:04.463934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:04.463934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:04.661911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:04.686366 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8b580ea8-c658-47d8-960d-248b48488d46 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.236484 Aug 18 20:54:04.687155 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 41/87] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:04 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:04.772486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:04.773261 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:04.780020 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:04.780720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:04.781264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:04.782191 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:04.782871 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:04.783496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:04.914564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:04.915450 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:04.922551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:04.923230 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:04.923717 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:04.924442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:04.924896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:04.925319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:04.945978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:04.962168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-58d7f89a-4063-42c6-bacd-4a7894ccc878 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.195102 Aug 18 20:54:04.967811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 47/88] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:04 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:05.084502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:05.096274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-40c5a07d-4591-463f-99a2-c452920b4e42 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.191558 Aug 18 20:54:05.096850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 42/89] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:04 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:05.721433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:05.722077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:05.728852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:05.729358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:05.729796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:05.730689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:05.731149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:05.731610 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:05.912922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:05.924036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dd8dfea5-51df-453e-9b9b-b30ef9613f69 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.206155 Aug 18 20:54:05.924823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 48/90] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:05 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:05.998465 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:05.999877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:06.011912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:06.012791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:06.013554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:06.014866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:06.015840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:06.016832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:06.126309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:06.126941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:06.135114 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:06.135662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:06.136109 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:06.137049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:06.137518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:06.137982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:06.228799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:06.259616 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2d84108f-0e62-4ab1-9de8-ae24d278ba9a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.255503 Aug 18 20:54:06.259616 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 43/91] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:05 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:06.360955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:06.370870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c04c3055-2d17-44f2-b1a7-9b5e0788e658 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.248552 Aug 18 20:54:06.371495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 49/92] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:06 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:06.947648 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:06.948571 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:06.959867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:06.962107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:06.962423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:06.964982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:06.965922 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:06.967090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:06.998611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:07.222893 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:07.236153 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-207165be-0bd8-4cb7-bc40-4660fed47a75 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.292981 Aug 18 20:54:07.237203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 44/93] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:06 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:07.281887 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:07.282699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:07.299734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:07.301191 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:07.301802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:07.304455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:07.305771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:07.306407 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:07.393100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:07.394047 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:07.418691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:07.420060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:07.420801 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:07.422080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:07.422885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:07.423677 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:07.727737 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:07.735874 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6066204c-8d0d-443d-b1f2-e430717fb3bf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.347052 Aug 18 20:54:07.737183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 45/94] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:07 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:07.765988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:07.782119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7d4091af-2f19-49d0-9da4-1f5d89bc11a7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.504182 Aug 18 20:54:07.787707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 50/95] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:07 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:08.261921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:08.263181 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:08.285518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:08.285518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:08.285518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:08.285518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:08.286053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:08.286474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:08.505854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:08.526535 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-622f2513-3d2e-4c3f-90b2-177c0ee5422e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.271285 Aug 18 20:54:08.528702 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 46/96] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:08 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:08.771390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:08.772633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:08.780912 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:08.781739 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:08.782380 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:08.783392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:08.784066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:08.784691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:08.815013 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:08.817022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:08.836212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:08.837341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:08.838308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:08.840336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:08.841509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:08.842880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:09.040875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:09.048576 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.057808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-326e3c6c-b083-407b-b405-71b182e71f6a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.291856 Aug 18 20:54:09.059616 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 51/97] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:08 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:09.141694 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:09.161251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d90a906b-7e78-42a5-b1de-06c4fc6b26f6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.350143 Aug 18 20:54:09.176063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 47/98] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:08 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:09.562355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:09.563493 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:09.589659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:09.598279 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:09.602282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:09.604265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:09.607643 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:09.608747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:09.854156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:09.860872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-481c67bd-a5b6-47af-b381-beef1ac35cfb tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.306159 Aug 18 20:54:09.861835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 52/99] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:09 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:10.102110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:10.104197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:10.113540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:10.114396 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:10.115481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:10.116977 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:10.117616 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:10.118538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:10.200230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:10.201045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:10.224809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:10.225626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:10.226659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:10.227724 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:10.230995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:10.230995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:10.387988 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:10.406961 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c8238364-60c2-4fd6-8862-837caba976b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.310382 Aug 18 20:54:10.408995 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 48/100] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:10 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:10.509423 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:10.517986 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-daa9f343-b300-46b0-8007-0b8e19280d7b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.327825 Aug 18 20:54:10.518567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 53/101] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:10 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:10.885236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:10.886255 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:10.895557 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:10.896211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:10.896650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:10.897656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:10.898565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:10.899508 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:11.093038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:11.114182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c2e64480-96db-43f5-82ac-1cc0a8bf4771 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.231460 Aug 18 20:54:11.136075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 49/102] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:10 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:11.446427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:11.447972 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:11.469992 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:11.476232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:11.477346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:11.478733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:11.479814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:11.480614 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:11.543400 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:11.544482 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:11.576774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:11.577498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:11.578233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:11.579611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:11.580458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:11.581209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:11.846128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:11.860987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4acca0fb-3fc1-4b13-aca9-082c28ff5443 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.432864 Aug 18 20:54:11.863967 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 54/103] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:11 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:12.040634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:12.051508 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b2efaf81-3bcb-4db0-8082-5f1841e3e305 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.515176 Aug 18 20:54:12.052528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 50/104] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:11 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:12.154081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-7a60d691-be0d-4a9f-ac26-c6d391a84ef0 req-c56c3aba-c16a-4b4f-a095-9142d01c32de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629e5883-6808-4193-8639-e5461fc0ce76", "name": "network-vif-plugged", "status": "completed", "tag": "e19522c1-8141-425b-9590-25796bc4b274"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:12.154415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:12.156143 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:12.168654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:12.169594 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:12.178511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:12.178866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7a60d691-be0d-4a9f-ac26-c6d391a84ef0 req-c56c3aba-c16a-4b4f-a095-9142d01c32de service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:12.178866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7a60d691-be0d-4a9f-ac26-c6d391a84ef0 req-c56c3aba-c16a-4b4f-a095-9142d01c32de service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:12.178866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7a60d691-be0d-4a9f-ac26-c6d391a84ef0 req-c56c3aba-c16a-4b4f-a095-9142d01c32de service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:12.179247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:12.179247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:12.179247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:12.193571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-7a60d691-be0d-4a9f-ac26-c6d391a84ef0 req-c56c3aba-c16a-4b4f-a095-9142d01c32de service nova] Creating event network-vif-plugged:e19522c1-8141-425b-9590-25796bc4b274 for instance 629e5883-6808-4193-8639-e5461fc0ce76 on hv-cinder-85265 Aug 18 20:54:12.204431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-7a60d691-be0d-4a9f-ac26-c6d391a84ef0 req-c56c3aba-c16a-4b4f-a095-9142d01c32de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137657 Aug 18 20:54:12.207136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 55/105] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:54:12.490491 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:12.501718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f2004f24-5c79-4baf-8e0d-bbcaab16b075 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.353494 Aug 18 20:54:12.502504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 51/106] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:12 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:12.901960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:12.903451 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:12.914419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:12.915647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:12.916818 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:12.918052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:12.919117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:12.920042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:13.081722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:13.083005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:13.099580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:13.100394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:13.101282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:13.102441 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:13.107398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:13.107398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:13.202425 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:13.218106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f7dee396-323f-48c3-82a5-ddde42b149e7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.322904 Aug 18 20:54:13.220975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 56/107] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:12 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:13.425828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:13.449288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ec9ef49f-9a96-4743-b56a-6aedf67218d8 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.378891 Aug 18 20:54:13.452022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 52/108] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:13 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:13.543664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:13.548380 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:13.579047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:13.579293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:13.582354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:13.586344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:13.586997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:13.587778 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:14.122780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:14.134715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-29666a10-d504-49ee-b11b-70c5bee233b8 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.604456 Aug 18 20:54:14.135603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 57/109] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:13 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:14.273910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:14.275177 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:14.310386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:14.312947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:14.313757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:14.315017 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:14.317100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:14.318469 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:14.490264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:14.491395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:14.582899 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:14.586086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:14.592165 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:14.593130 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:14.593849 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:14.597913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:15.030288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:15.045462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f49dacec-f038-427c-8ef3-455341cbb41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.781735 Aug 18 20:54:15.046912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 53/110] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:14 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:15.176957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:15.177890 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:15.184845 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:15.185397 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:15.185933 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:15.186686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:15.187192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:15.187698 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:15.222677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:15.231057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-767e224d-568b-4435-808f-87d1d0dbc876 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.749315 Aug 18 20:54:15.244023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 58/111] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:14 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:15.477064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:15.486624 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a13459b1-b881-4867-a92d-af88f3ac88dd tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.314185 Aug 18 20:54:15.492493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 54/112] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:15 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:15.908342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-188d77f9-e8fb-48c1-887e-f41f2b37edef req-b183c010-5e88-48f1-b0ff-71b6e114f876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6d725b-6c0e-43f3-b240-99f9a739d63f", "name": "network-vif-plugged", "status": "completed", "tag": "f5399b38-95d8-4997-bf45-40f7f8ef7c71"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:15.927283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-188d77f9-e8fb-48c1-887e-f41f2b37edef req-b183c010-5e88-48f1-b0ff-71b6e114f876 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:15.928532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-188d77f9-e8fb-48c1-887e-f41f2b37edef req-b183c010-5e88-48f1-b0ff-71b6e114f876 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:15.929345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-188d77f9-e8fb-48c1-887e-f41f2b37edef req-b183c010-5e88-48f1-b0ff-71b6e114f876 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:15.954006 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-188d77f9-e8fb-48c1-887e-f41f2b37edef req-b183c010-5e88-48f1-b0ff-71b6e114f876 service nova] Creating event network-vif-plugged:f5399b38-95d8-4997-bf45-40f7f8ef7c71 for instance df6d725b-6c0e-43f3-b240-99f9a739d63f on hv-cinder-85265 Aug 18 20:54:15.965151 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-188d77f9-e8fb-48c1-887e-f41f2b37edef req-b183c010-5e88-48f1-b0ff-71b6e114f876 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063645 Aug 18 20:54:15.968307 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 59/113] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:54:16.069202 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:16.071521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:16.084601 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:16.085851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:16.086815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:16.088706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:16.089360 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:16.089875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:16.261531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:16.272357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:16.287572 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:16.289211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:16.290398 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:16.291947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:16.293155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:16.294158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:16.342537 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:16.371350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-dd4cda6f-48d4-42a3-9bc0-53ed21bc6c99 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.305753 Aug 18 20:54:16.376271 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 55/114] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:16 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:16.524564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:16.525197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:16.538652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:16.538969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:16.539687 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:16.540685 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:16.541170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:16.541732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:16.720393 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:16.729873 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a91e5bb0-ad75-4bd2-8cb0-b4ab96d7876f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.211306 Aug 18 20:54:16.730472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 56/115] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:16 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:16.892100 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:16.901196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-840e8b8e-6a7d-434c-a5e3-25de9b15d585 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.649940 Aug 18 20:54:16.901804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 60/116] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:16 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:17.413841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:17.415083 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:17.426191 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:17.427145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:17.428290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:17.429488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:17.430259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:17.431024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:17.638357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:17.647723 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f6ad3eeb-c192-4621-8ffd-6ff0fee6b49c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.240476 Aug 18 20:54:17.648301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 57/117] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:17 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:17.753542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:17.755143 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:17.762466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:17.763043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:17.763595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:17.764380 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:17.765144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:17.765604 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:17.931338 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:17.939263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:17.946237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:17.947238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:17.948003 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:17.949401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:17.950206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:17.951308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:17.955978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:17.965908 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-aec269df-a9be-463c-9a4c-31b2070c230a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.216869 Aug 18 20:54:17.967048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 61/118] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:17 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:18.184582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:18.197175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3b50ffc0-b2e6-40b8-ac55-e7cd96dd6a31 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.276446 Aug 18 20:54:18.198456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 58/119] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:17 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:18.672854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:18.673929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:18.681611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:18.682360 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:18.683094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:18.684210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:18.684750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:18.685365 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:18.953593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:18.968029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-64fa678e-19bd-4f65-86ef-b6902a1e16a1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.301259 Aug 18 20:54:18.969113 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 62/120] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:18 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:18.999153 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:19.001066 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:19.010831 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:19.011434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:19.012046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:19.012751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:19.013365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:19.014034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:19.230864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:19.231808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:19.242734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:19.243664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:19.244456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:19.244662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:19.245848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:19.246683 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:19.247502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:19.254387 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-46d39757-c2eb-4389-a4a0-ff1dc5d20eb3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.260156 Aug 18 20:54:19.255297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 59/121] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:18 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:19.483471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:19.493549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-fe19defb-48ac-4ffc-81fd-e94e53b11a0c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.269422 Aug 18 20:54:19.494354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 63/122] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:19 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:19.997529 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:19.998358 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:20.000647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=71 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:20.008107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:20.008715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:20.009240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:20.010214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:20.010858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:20.011663 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:20.290128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:20.291282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:20.300712 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:20.301525 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:20.302287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:20.303841 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:20.304862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:20.305794 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:20.316166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:20.333943 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9d41ff73-a571-43ac-850e-475d1e5c8cea tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.341141 Aug 18 20:54:20.336027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 60/123] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:19 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:20.485479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:20.495977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9c401e33-71c0-4184-9d07-5f699ba076d7 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.212954 Aug 18 20:54:20.496761 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 64/124] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:20 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:20.523200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:20.524137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:20.532116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:20.532841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:20.533377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:20.534228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:20.534735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:20.535263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:20.540883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:20.707554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:20.716856 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e5c7697f-bf5c-4ba1-b273-d60b4af06b23 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.201849 Aug 18 20:54:20.717910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 61/125] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:20 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:21.367594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:21.368304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:21.378862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:21.379099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:21.379602 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:21.380362 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:21.381027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:21.381464 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:21.533043 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:21.533837 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:21.547187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:21.551348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:21.552057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:21.553046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:21.553722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:21.554384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:21.573509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:21.583444 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4052369b-25dd-4db9-91ad-c9298b9a1a7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.219673 Aug 18 20:54:21.597544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 65/126] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:21 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:21.742046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:21.742282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:21.742800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:21.749502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:21.750102 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:21.750608 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:21.751431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:21.752100 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:21.752604 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:21.755472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b38641d4-ffd5-483a-bc62-d8d33025849f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.228044 Aug 18 20:54:21.756409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 62/127] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:21 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:21.918773 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:21.931848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b8fc131e-4c06-44a1-ada6-8a9323d04586 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.192065 Aug 18 20:54:21.931848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 66/128] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:21 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:22.611625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:22.613269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:22.623718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:22.624427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:22.625218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:22.626049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:22.626683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:22.630641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:22.777840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:22.779731 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:22.789096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:22.790636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:22.791589 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:22.793030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:22.794772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:22.795490 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:22.876187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:22.885652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-38817a4b-6316-4bda-9b98-bf0fd54e190d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.281351 Aug 18 20:54:22.900035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 63/129] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:22 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:22.953989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:22.954603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:22.960933 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:22.970667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:22.970667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:22.970667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:22.970667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:22.971077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:23.019548 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:23.037167 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-47877c8d-ff59-4044-baf1-21e5d553ed9b tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.263680 Aug 18 20:54:23.056092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 67/130] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:22 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:23.136951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:23.150277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-07bc9866-4958-4905-8c7d-d175417a7769 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.200130 Aug 18 20:54:23.150859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 64/131] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:22 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:23.167811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-8d3c5b12-84e0-46c6-bcaa-c78f6f0c4a59 req-b95fcb90-8e3b-4e52-a4c1-2a6b29767889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc448b9-4ec7-434a-b395-d4a344b78179", "name": "network-vif-plugged", "status": "completed", "tag": "5fe340e0-9ebc-47a8-b2f9-dcc9d92c95b3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:23.181308 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8d3c5b12-84e0-46c6-bcaa-c78f6f0c4a59 req-b95fcb90-8e3b-4e52-a4c1-2a6b29767889 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:23.181800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8d3c5b12-84e0-46c6-bcaa-c78f6f0c4a59 req-b95fcb90-8e3b-4e52-a4c1-2a6b29767889 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:23.182230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8d3c5b12-84e0-46c6-bcaa-c78f6f0c4a59 req-b95fcb90-8e3b-4e52-a4c1-2a6b29767889 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:23.194945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-8d3c5b12-84e0-46c6-bcaa-c78f6f0c4a59 req-b95fcb90-8e3b-4e52-a4c1-2a6b29767889 service nova] Creating event network-vif-plugged:5fe340e0-9ebc-47a8-b2f9-dcc9d92c95b3 for instance 1cc448b9-4ec7-434a-b395-d4a344b78179 on hv-cinder-85265 Aug 18 20:54:23.200318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-8d3c5b12-84e0-46c6-bcaa-c78f6f0c4a59 req-b95fcb90-8e3b-4e52-a4c1-2a6b29767889 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050099 Aug 18 20:54:23.200911 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 68/132] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:54:23.910064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:23.911998 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:23.919476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:23.920229 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:23.920835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:23.921710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:23.922320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:23.923638 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:24.077463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:24.078357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:24.088931 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:24.089849 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:24.091105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:24.093092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:24.093785 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:24.094472 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:24.159874 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:24.176289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f253f6aa-88af-454d-887b-2aceca2daff6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.272053 Aug 18 20:54:24.184781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 65/133] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:23 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:24.217439 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:24.219779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:24.266665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:24.272124 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:24.273223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:24.274411 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:24.277239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:24.278269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:24.502486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:24.513964 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d8466e8e-9d98-4583-8149-4997a3fb9dfa tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.442834 Aug 18 20:54:24.519542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 69/134] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:24 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:24.567542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:24.576935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6603cf05-50ed-42d5-bf9c-b8de9959768e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.390161 Aug 18 20:54:24.577732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 66/135] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:24 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:25.202052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:25.202785 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:25.210755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:25.211318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:25.211888 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:25.212796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:25.213505 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:25.214029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:25.237846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:25.383932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:25.398024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4a3b61e1-b294-4426-b678-8164c1ceeb11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.199543 Aug 18 20:54:25.398734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 70/136] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:25 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:25.543430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:25.544366 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:25.551407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:25.551892 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:25.552326 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:25.553032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:25.553485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:25.553908 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:25.603418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:25.604648 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:25.631342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:25.634478 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:25.634478 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:25.635692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:25.636638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:25.637247 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:25.807673 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:25.829967 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5856a8bd-109d-4220-802e-858d7016eb3a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.289238 Aug 18 20:54:25.832757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 67/137] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:25 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:25.923864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:25.948154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-241d6502-d670-47bf-844c-41d7ab2c79a0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.349240 Aug 18 20:54:25.949741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 71/138] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:25 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:26.431834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:26.432857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:26.440418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:26.440994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:26.441674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:26.442421 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:26.442860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:26.443549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:26.611437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:26.620842 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-964dff1f-35ec-4d9c-92e0-882ca0de1943 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.197606 Aug 18 20:54:26.622182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 68/139] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:26 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:26.873255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:26.874495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:26.886780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:26.887278 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:26.887887 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:26.888462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:26.888907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:26.889328 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:26.978652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:26.979178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:26.988062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:26.988790 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:26.989737 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:26.990810 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:26.991399 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:26.991948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:27.077424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:27.099180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ad2cefcf-75df-4c39-a441-7070997e2f22 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.231546 Aug 18 20:54:27.115392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 72/140] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:26 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:27.227187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:27.236281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-137f7bcc-1d2a-4d83-a3b8-168ebb7fcfff tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.265912 Aug 18 20:54:27.236877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 69/141] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:26 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:27.650550 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:27.650861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:27.657711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:27.659590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:27.660268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:27.661188 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:27.661836 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:27.662441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:27.808221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:27.817915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-546a799e-e752-4e90-83a0-054d1750c9cd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.171457 Aug 18 20:54:27.832213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 73/142] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:27 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:28.126402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:28.128212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:28.135109 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:28.135664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:28.136263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:28.136969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:28.137423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:28.137866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:28.258889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:28.259611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:28.265808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:28.266284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:28.266713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:28.267701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:28.268227 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:28.269352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:28.276843 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:28.286435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3b8c5e5a-d17e-4d8f-89b2-a3a50c0f3808 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.165597 Aug 18 20:54:28.290927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 70/143] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:28 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:28.587790 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:28.596268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-142c0bec-cbaa-4789-9002-e77a486c224a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.341305 Aug 18 20:54:28.597240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 74/144] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:28 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:28.839134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:28.839782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:28.848350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:28.848350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:28.848350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:28.848350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:28.849525 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:28.849525 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:28.992301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:29.009064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d812b46f-7746-4434-977e-ccb2ba9b407c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.168053 Aug 18 20:54:29.009064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 71/145] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:28 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:29.311810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:29.312448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:29.318819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=76 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:29.319913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:29.320861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:29.321367 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:29.322145 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:29.322614 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:29.323155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:29.473281 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:29.482647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-be3c6343-5978-4579-846b-e8f82e98e1c6 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1315 microversion: 2.1 time: 0.174705 Aug 18 20:54:29.483232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 75/146] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:29 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:29.618062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:29.619280 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:29.625522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:29.626016 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:29.626454 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:29.627157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:29.627857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:29.628447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:29.803969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:29.803969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b07f0d74-7b97-40b8-8863-b5ab2747f975 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.180895 Aug 18 20:54:29.803969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 72/147] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:29 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:30.057526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:30.057526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:30.057526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:30.057526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:30.058606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:30.058606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:30.058606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:30.058606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:30.179538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:30.187779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0de6e4ff-b217-43ad-b54e-d0e71bcf46b1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.161330 Aug 18 20:54:30.191561 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 76/148] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:30 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:30.510911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:30.511604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:30.518841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:30.519336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:30.519806 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:30.520545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:30.521001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:30.521425 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:30.755835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:30.771162 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-16c7141f-4ec2-4e90-89e3-b140aaed5b2e tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1502 microversion: 2.1 time: 0.263740 Aug 18 20:54:30.772323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 73/149] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:30 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1502 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:30.832039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:30.832762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:30.840171 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:30.857043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:30.857043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:30.857043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:30.857043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:30.857679 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:30.951796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-0fd8d353-cbe8-4856-8c45-bc68e53d5360 req-4b5e1428-d023-47a2-9db2-8a8696c1ce38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81738bf-5d23-441d-8b75-e66cf5781acf", "name": "network-vif-plugged", "status": "completed", "tag": "815b310a-9ed7-4cf5-bc0c-e3c9a87a8824"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:30.962801 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0fd8d353-cbe8-4856-8c45-bc68e53d5360 req-4b5e1428-d023-47a2-9db2-8a8696c1ce38 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:30.963802 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0fd8d353-cbe8-4856-8c45-bc68e53d5360 req-4b5e1428-d023-47a2-9db2-8a8696c1ce38 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:30.964399 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0fd8d353-cbe8-4856-8c45-bc68e53d5360 req-4b5e1428-d023-47a2-9db2-8a8696c1ce38 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:30.980130 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-0fd8d353-cbe8-4856-8c45-bc68e53d5360 req-4b5e1428-d023-47a2-9db2-8a8696c1ce38 service nova] Creating event network-vif-plugged:815b310a-9ed7-4cf5-bc0c-e3c9a87a8824 for instance a81738bf-5d23-441d-8b75-e66cf5781acf on hv-cinder-85265 Aug 18 20:54:30.987434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-0fd8d353-cbe8-4856-8c45-bc68e53d5360 req-4b5e1428-d023-47a2-9db2-8a8696c1ce38 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038993 Aug 18 20:54:30.988684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 74/150] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:54:31.022571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:31.031059 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b05b7e2f-3244-4664-a326-452b06d4a50e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.208878 Aug 18 20:54:31.031865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 77/151] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:30 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:31.214336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:31.214942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:31.221692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:31.222179 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:31.222643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:31.223354 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:31.224166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:31.224590 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:31.403555 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:31.412325 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6dc8c673-7c15-42dd-a94b-ba550f77aab8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1321 microversion: 2.1 time: 0.202278 Aug 18 20:54:31.412901 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 75/152] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:31 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:32.053438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:32.060312 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:32.061647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:32.062958 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:32.063483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:32.064636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:32.065853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:32.066622 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:32.217171 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:32.235435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7c0fa693-f48b-471a-bf87-c4ab0d26394e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.185957 Aug 18 20:54:32.237398 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 78/153] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:32 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:32.434401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:32.435202 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:32.444824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:32.445731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:32.446498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:32.447703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:32.448250 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:32.448715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:32.608125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:32.617705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b7c5521e-63d4-485e-8092-6ae48e0c1ff5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1515 microversion: 2.1 time: 0.187912 Aug 18 20:54:32.618383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 76/154] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:32 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:32.639242 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:32.646184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:32.648493 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:32.648991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:32.649426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:32.650136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:32.650591 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:32.651016 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:32.720005 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lazy-loading 'flavor' on Instance uuid 1cc448b9-4ec7-434a-b395-d4a344b78179 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:54:33.083902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-31aa9f9d-34cf-42bf-9383-9558dc957e84 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179/action" status: 200 len: 32 microversion: 2.1 time: 0.448044 Aug 18 20:54:33.084924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 79/155] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 20:54:32 2022] POST /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179/action => generated 32 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 20:54:33.096073 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:33.096894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:33.113275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:33.114356 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:33.116437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:33.120813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:33.121513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:33.122146 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:33.263386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:33.264273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:33.272042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:33.272750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:33.273308 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:33.274087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:33.274642 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:33.275124 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:33.313808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:33.323330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-db55c305-b683-487c-8cba-4d68096faff4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.232340 Aug 18 20:54:33.323976 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 77/156] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:33 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:33.485445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:33.494405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-88e5c3e0-42a5-4f34-8e45-a0b7986a40e0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.238111 Aug 18 20:54:33.494987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 80/157] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:33 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:33.959231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69bfdc6-754e-4e39-98c4-465932500d2f"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:33.961635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:33.968081 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:33.970212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:33.970212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:33.970212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:33.970212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:33.970564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:34.029527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.345834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:34.346664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:34.353754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:34.354660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:34.355476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:34.356724 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:34.357350 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:34.357996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:34.518324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:34.526752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5f158d40-84ad-4d6a-9419-955b014d1d57 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.185855 Aug 18 20:54:34.530141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 81/158] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:34 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:34.531934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:34.532636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:34.539253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:34.539819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:34.540328 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:34.540989 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:34.541611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:34.542043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:34.686092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:34.694419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-69d175d7-4609-411d-8906-29f4e3713d09 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.166001 Aug 18 20:54:34.695001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 82/159] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:34 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:35.558750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:35.559389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:35.565997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:35.566486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:35.567141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:35.567869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:35.568320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:35.568869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:35.704244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:35.711915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-63901202-f4cc-4f19-a58b-94a9487323dc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.157149 Aug 18 20:54:35.712463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 83/160] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:35 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:35.718397 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:35.718397 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:35.723851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:35.724473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:35.724760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:35.725639 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:35.726235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:35.726662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:35.872775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:35.881630 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-07983e71-8926-47b4-b824-2d7fd1830cb1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.168169 Aug 18 20:54:35.882293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 84/161] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:35 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:36.738486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:36.739174 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:36.745419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:36.745984 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:36.746428 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:36.747199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:36.747683 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:36.748128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:36.753128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:36.884466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:36.893854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ff65e396-c907-4689-9e78-3b5088cf6dd6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.159662 Aug 18 20:54:36.894445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 85/162] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:36 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:36.912030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:36.912649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:36.922540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:36.923350 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:36.924075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:36.925407 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:36.925993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:36.926533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:37.072036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:37.083830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4bf7e382-9fc2-4dca-9e62-6ea6f031d9bc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.184603 Aug 18 20:54:37.084376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 86/163] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:36 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:37.916515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:37.917149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:37.924646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:37.924914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:37.925357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:37.926050 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:37.926674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:37.927301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:38.073597 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:38.083282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cce35f52-0370-4656-83a8-3199150e2c41 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.169629 Aug 18 20:54:38.084633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 87/164] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:37 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:38.107960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:38.110783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:38.122486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:38.123039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:38.123592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:38.125178 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:38.125661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:38.126274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:38.347892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:38.373568 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ccc26abf-66c6-4509-80c7-cc1b319d86ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.271399 Aug 18 20:54:38.374256 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 88/165] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:38 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:38.812934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5f4f0061-fc93-4096-a6de-d1290dcc6132 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "POST /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.852689 Aug 18 20:54:38.812934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 78/166] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 20:54:33 2022] POST /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76/os-volume_attachments => generated 194 bytes in 4854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:54:39.116535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:39.117047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:39.122972 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:39.124284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:39.124284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:39.124625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:39.125061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:39.125483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:39.398329 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:39.399213 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:39.406495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:39.407176 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:39.407845 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:39.408788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:39.409393 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:39.410118 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:39.537310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:39.545283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0d161afb-55fc-4398-8603-63dc7ffde2fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.432695 Aug 18 20:54:39.545978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 89/167] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:39 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:39.561819 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:39.570062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-29ee0391-8d39-49af-b0d1-5c0241708852 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1365 microversion: 2.1 time: 0.177482 Aug 18 20:54:39.578841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 79/168] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:39 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:40.568241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:40.568925 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:40.576433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:40.577285 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:40.578375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:40.579346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:40.580037 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:40.581440 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:40.613852 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:40.613852 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:40.623274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:40.623824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:40.624261 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:40.624959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:40.625416 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:40.625839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:40.761641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:40.769957 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-52bb1682-06df-4fa1-af0b-a986f43874d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.206630 Aug 18 20:54:40.770653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 90/169] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:40 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:40.775085 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:40.782934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ee9caf30-105e-4e73-a969-bc0abed68b48 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1555 microversion: 2.1 time: 0.187224 Aug 18 20:54:40.784030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 80/170] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:40 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:40.807865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:40.808359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:40.814491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:40.814983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:40.815483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:40.816182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:40.816632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:40.817053 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:40.901320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d72abe48-5506-451b-91b8-88a5768b7604 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097251 Aug 18 20:54:40.901922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 91/171] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 20:54:40 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:54:41.792296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:41.793525 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:41.801544 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:41.802042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:41.802642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:41.803354 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:41.804039 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:41.804432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:42.026408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:42.036530 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0086ee95-9e86-49b0-a553-17fc0c04086e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.248428 Aug 18 20:54:42.037559 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 81/172] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:41 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:42.555137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-a2451de8-a8ff-47fb-b7f5-2a2a41d11692 req-c0d91446-33e4-427d-bad9-e3e994132a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81738bf-5d23-441d-8b75-e66cf5781acf", "tag": "815b310a-9ed7-4cf5-bc0c-e3c9a87a8824"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:54:42.565585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2451de8-a8ff-47fb-b7f5-2a2a41d11692 req-c0d91446-33e4-427d-bad9-e3e994132a21 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:42.566168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2451de8-a8ff-47fb-b7f5-2a2a41d11692 req-c0d91446-33e4-427d-bad9-e3e994132a21 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:42.569316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-a2451de8-a8ff-47fb-b7f5-2a2a41d11692 req-c0d91446-33e4-427d-bad9-e3e994132a21 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:42.578485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-a2451de8-a8ff-47fb-b7f5-2a2a41d11692 req-c0d91446-33e4-427d-bad9-e3e994132a21 service nova] Creating event network-changed:815b310a-9ed7-4cf5-bc0c-e3c9a87a8824 for instance a81738bf-5d23-441d-8b75-e66cf5781acf on hv-cinder-85265 Aug 18 20:54:42.585814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-a2451de8-a8ff-47fb-b7f5-2a2a41d11692 req-c0d91446-33e4-427d-bad9-e3e994132a21 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036480 Aug 18 20:54:42.586543 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 92/173] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:54:43.061846 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:43.062448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:43.069017 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:43.069504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:43.069936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:43.070628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:43.071077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:43.071527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:43.232940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:43.241873 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7a91bba7-fe98-4ee7-bb1b-c50ec5e389d3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.183721 Aug 18 20:54:43.242475 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 82/174] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:43 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:44.265802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:44.266492 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:44.273513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:44.274003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:44.274437 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:44.275126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:44.275609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:44.276062 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:44.422535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:44.431970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9130c718-9b9f-43a3-bc47-a9aa14b5eb90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.170255 Aug 18 20:54:44.432582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 93/175] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:44 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:45.454872 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:45.456248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:45.463089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:45.463612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:45.464045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:45.464784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:45.465221 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:45.465641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:45.623621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:45.631739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6515b534-ee09-4780-a4aa-12df88c54f43 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.181431 Aug 18 20:54:45.632320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 83/176] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:45 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:46.653896 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:46.654568 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:46.663257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:46.663257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:46.663257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:46.663257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:46.663603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:46.663823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:46.799848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:46.808048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-350bc3c0-277a-457c-a2c4-3eb7a2da9043 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.157930 Aug 18 20:54:46.808689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 94/177] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:46 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:47.830154 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:47.830919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:47.837977 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:47.838693 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:47.839202 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:47.840106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:47.840637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:47.841164 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:47.976229 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:47.984588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-24bf7a7d-782f-4416-92ce-003019a61b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.158905 Aug 18 20:54:47.985398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 84/178] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:47 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:49.008168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:49.008793 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:49.014955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:49.015494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:49.015965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:49.016677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:49.017137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:49.018007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:49.183561 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:49.192989 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6d102a10-2052-4298-9e20-85e9f2ba12b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.190230 Aug 18 20:54:49.193569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 95/179] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:49 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:50.218120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:50.218735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:50.221215 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=50 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:50.225936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:50.226425 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:50.226862 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:50.227605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:50.228134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:50.228564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:50.371353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:50.379545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9c9e75ee-be04-4d2f-aa60-7ac72d1d2012 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.165341 Aug 18 20:54:50.380106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 85/180] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:50 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:51.402159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:51.402774 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:51.409578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:51.410066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:51.410504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:51.415926 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:51.416811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:51.417193 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:51.562961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:51.571507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-fa82e9d9-e756-4caa-b9c5-8e18a6ba3bce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.173330 Aug 18 20:54:51.572192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 96/181] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:51 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:52.596235 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:52.597017 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:52.605782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:52.621162 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:52.621883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:52.622868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:52.626978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:52.628315 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:52.808074 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:52.817153 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a22a7fe2-1ecb-4a82-a2ba-c3c40f74d005 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.227468 Aug 18 20:54:52.835499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 86/182] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:52 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:53.840160 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:53.841628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:53.847883 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:53.848443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:53.848962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:53.849655 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:53.850112 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:53.850532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:53.993193 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:54.004272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-93c9a4f6-a3d9-4990-903e-144339fd3829 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.169847 Aug 18 20:54:54.004851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 97/183] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:53 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:55.024443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:55.025099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:55.032649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:55.033150 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:55.033594 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:55.034522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:55.035005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:55.035584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:55.178106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:55.186226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6169bfed-6237-4a3c-be96-eb2559867f10 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.165661 Aug 18 20:54:55.186895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 87/184] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:55 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:55.510668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:55.511221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:55.530505 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:55.531000 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:55.531468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:55.532177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:55.532633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:55.533072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:55.573713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 20:54:56.123352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1cefdab4-5457-4f91-8cfe-46c2adb2971f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "DELETE /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 204 len: 0 microversion: 2.1 time: 0.616245 Aug 18 20:54:56.123978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 98/185] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 20:54:55 2022] DELETE /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:56.133823 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:56.134444 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:56.140796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:56.141377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:56.141816 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:56.146269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:56.146751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:56.147192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:56.209733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:56.210436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:56.216528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:56.217431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:56.217431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:56.218133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:56.218582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:56.219004 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:56.286102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:56.295225 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5b6aa03c-29c5-44f3-b69c-403e95236454 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1554 microversion: 2.1 time: 0.165230 Aug 18 20:54:56.295835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 88/186] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:56 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:56.372044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:56.382689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dca41c14-ddb3-4423-b73d-a5ee71c3f867 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.177175 Aug 18 20:54:56.383257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 99/187] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:56 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:57.316721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:57.317330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:57.323896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:57.324382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:57.324875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:57.325517 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:57.326004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:57.326478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:57.408192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:57.408930 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:57.416162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:57.416751 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:57.417263 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:57.418053 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:57.418678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:57.419100 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:57.482018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:57.494628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1813362f-ca08-44ea-a272-901e76f2c97a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1554 microversion: 2.1 time: 0.181659 Aug 18 20:54:57.495273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 89/188] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:57 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:57.576816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:57.585363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-73d6b0fb-b8eb-4f77-838f-789d11066daa tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.183433 Aug 18 20:54:57.585940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 100/189] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:57 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:58.515214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:58.515854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:58.523428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:58.523984 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:58.524353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:58.525044 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:58.525485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:58.525903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:58.607086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:58.607586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:58.613966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:58.614449 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:58.614883 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:58.615597 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:58.616045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:58.616466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:58.620878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:58.659928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:58.668719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cb9bc364-f8c4-4918-9f06-c57bf24710fc tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1554 microversion: 2.1 time: 0.157241 Aug 18 20:54:58.669853 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 90/190] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:58 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:58.758396 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:58.766625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-83c7bea8-e951-4f11-a6e1-8bb2dead784b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.163575 Aug 18 20:54:58.768140 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 101/191] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:58 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:54:59.691067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:59.691703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:59.698682 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:59.699173 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:59.699634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:59.700350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:59.700799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:59.701214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:59.791943 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:54:59.792682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:54:59.794828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:59.799588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:59.800241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:59.803816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:59.803816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:54:59.803816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:54:59.803816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:54:59.841666 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:59.850811 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-dca777b8-02cd-4ade-9f36-6a69077fee2f tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1554 microversion: 2.1 time: 0.164385 Aug 18 20:54:59.851552 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 91/192] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:59 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:59.937892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:54:59.946345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b5408e5b-02ac-4d77-b2b1-01109d658184 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.158565 Aug 18 20:54:59.946840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 102/193] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:54:59 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:00.871771 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:00.872474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:00.880071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:00.880562 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:00.880998 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:00.881705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:00.882155 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:00.882583 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:00.968404 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:00.969010 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:00.975594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:00.978803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:00.978803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:00.978803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:00.978803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:00.979747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:01.067834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:01.081187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-39171dc7-b35b-4c99-a715-f878a1d49563 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1554 microversion: 2.1 time: 0.213272 Aug 18 20:55:01.081763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 92/194] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:00 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:01.180136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:01.188254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e2bfccfd-ca3c-4590-ab09-a57e28ccb7a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.224367 Aug 18 20:55:01.189500 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 103/195] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:00 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:02.102220 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:02.103078 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:02.109288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:02.109771 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:02.110206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:02.110936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:02.111413 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:02.119588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:02.210990 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:02.211627 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:02.218953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:02.219491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:02.220516 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:02.221651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:02.222155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:02.222810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:02.249046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:02.253120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:02.259557 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5836ce9b-a233-4354-9726-62e34b91988a tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1554 microversion: 2.1 time: 0.161321 Aug 18 20:55:02.260142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 93/196] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:02 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:02.394224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:02.402372 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b35ad1a2-5f66-440b-aa5f-ea1a5c69f68d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.195681 Aug 18 20:55:02.402978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 104/197] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:02 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:03.281962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:03.283691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:03.291049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:03.291931 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:03.292429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:03.293195 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:03.293812 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:03.294412 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:03.426082 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:03.427551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:03.437944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:03.438664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:03.440991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:03.442177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:03.445274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:03.445872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:03.574880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:03.585851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c7779274-396c-4d3f-b978-76b777e836da tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1554 microversion: 2.1 time: 0.307878 Aug 18 20:55:03.587293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 94/198] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:03 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1554 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:03.784210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:03.792857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-235c9c86-bbbb-47b4-a7fd-4281f257eb77 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.372175 Aug 18 20:55:03.794094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 105/199] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:03 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:04.493867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-4b42bf84-5706-47df-90bb-24f4733c13bc req-4542dde5-f749-4051-a3be-e7f9344ae45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629e5883-6808-4193-8639-e5461fc0ce76", "name": "network-vif-deleted", "tag": "e19522c1-8141-425b-9590-25796bc4b274"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:04.510433 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-4b42bf84-5706-47df-90bb-24f4733c13bc req-4542dde5-f749-4051-a3be-e7f9344ae45f service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:04.511014 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-4b42bf84-5706-47df-90bb-24f4733c13bc req-4542dde5-f749-4051-a3be-e7f9344ae45f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:04.511651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-4b42bf84-5706-47df-90bb-24f4733c13bc req-4542dde5-f749-4051-a3be-e7f9344ae45f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:04.529138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-4b42bf84-5706-47df-90bb-24f4733c13bc req-4542dde5-f749-4051-a3be-e7f9344ae45f service nova] Creating event network-vif-deleted:e19522c1-8141-425b-9590-25796bc4b274 for instance 629e5883-6808-4193-8639-e5461fc0ce76 on hv-cinder-85265 Aug 18 20:55:04.545183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-4b42bf84-5706-47df-90bb-24f4733c13bc req-4542dde5-f749-4051-a3be-e7f9344ae45f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055422 Aug 18 20:55:04.550132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 95/200] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:55:04.608515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:04.609136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:04.617373 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:04.618115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:04.618555 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:04.619456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:04.619918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:04.620350 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:04.695596 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:04.704615 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f5a637ad-2c02-4dc8-b0f6-cbabd864c41c tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1512 microversion: 2.1 time: 0.099890 Aug 18 20:55:04.705424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 106/201] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:04 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1512 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:04.821251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:04.821948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:04.828212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:04.828780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:04.829214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:04.829902 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:04.830344 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:04.830761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:04.981761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:04.991501 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a0f5bfba-2606-4bfa-844b-d51679221fc7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.174581 Aug 18 20:55:04.992275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 96/202] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:04 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:05.725853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:05.726554 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:05.735189 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:05.735877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:05.736539 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:05.737496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:05.738343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:05.738906 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:05.814604 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:05.823471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7fde37a8-556f-41a6-8a45-d03d2e645469 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1346 microversion: 2.1 time: 0.101201 Aug 18 20:55:05.827673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 107/203] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:05 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:06.012269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:06.012880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:06.020261 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:06.020752 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:06.021190 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:06.022134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:06.022593 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:06.023018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:06.216844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:06.228012 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-30b4c8ef-2b42-4297-9b17-7df0029b82bb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.216956 Aug 18 20:55:06.228012 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 97/204] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:06 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:06.844612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:06.846094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:06.856613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:06.856613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:06.856613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:06.856613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:06.858258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:06.858833 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:06.894830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:06.895619 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:06.896060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:06.896584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lazy-loading 'fault' on Instance uuid 629e5883-6808-4193-8639-e5461fc0ce76 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:55:06.943850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b8a21b3d0747c68eda9f991d735772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a536708296847aeb7a88156d077da60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:06.952169 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-fd749331-20d5-4b1b-980f-b38af5b797d3 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 200 len: 1351 microversion: 2.1 time: 0.111331 Aug 18 20:55:06.952740 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 108/205] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:06 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 1351 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:07.247425 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:07.248071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:07.256279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:07.257057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:07.257569 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:07.258348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:07.258906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:07.259595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:07.412497 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:07.420847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-31a53d74-cf98-4bb4-83e8-684e8bcaf195 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.177399 Aug 18 20:55:07.421437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 98/206] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:07 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:07.974695 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:07.975342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:07.981525 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:07.982012 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:07.982448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:07.983149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:07.983638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:07.984074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:07.998669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] HTTP exception thrown: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Request method failure captured: Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 HTTP/1.1 Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGYjs9rcyFxgjoXBaCf-NX8qjP79_PXMuP9cK_eOGmBk5LgVe_w6fAdY6NrAc9WUGe9i_SRPhRvC8cflquZ5MNv5b_evQQtqGaXF1JVdPG4g3kQvVdEV-E-e4giBA8ssaMEGs_mT3ywwOlaxP0Uvy3auQhM6-1tFxvBP1_zzssjxw Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:55:08.003330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7a536708296847aeb7a88156d077da60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7a536708296847aeb7a88156d077da60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 41b8a21b3d0747c68eda9f991d735772 Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.004977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '629e5883-6808-4193-8639-e5461fc0ce76'} Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:55:08.005870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.007233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.008435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Returning 404 to user: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:55:08.008435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8a73001d-fa9f-44bb-9eea-1f3db14b2440 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 404 len: 111 microversion: 2.1 time: 0.034172 Aug 18 20:55:08.008435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 109/207] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:07 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:55:08.127621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:08.129926 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:08.137355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:08.138228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:08.138837 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:08.139597 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:08.140041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:08.140671 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:08.155104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] HTTP exception thrown: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Request method failure captured: Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76/os-volume_attachments HTTP/1.1 Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbGYjs9rcyFxgjoXBaCf-NX8qjP79_PXMuP9cK_eOGmBk5LgVe_w6fAdY6NrAc9WUGe9i_SRPhRvC8cflquZ5MNv5b_evQQtqGaXF1JVdPG4g3kQvVdEV-E-e4giBA8ssaMEGs_mT3ywwOlaxP0Uvy3auQhM6-1tFxvBP1_zzssjxw Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 20:55:08.160561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7a536708296847aeb7a88156d077da60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7a536708296847aeb7a88156d077da60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 41b8a21b3d0747c68eda9f991d735772 Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.162063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'server_id': '629e5883-6808-4193-8639-e5461fc0ce76'} Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:55:08.162875 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:08.166368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:55:08.167613 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Returning 404 to user: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:55:08.167613 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c081fd31-2cc8-48b8-aa86-4c22744f3dd4 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042092 Aug 18 20:55:08.167613 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 99/208] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 20:55:08 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:55:08.445361 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:08.445361 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:08.451065 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:08.451878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:08.452485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:08.453231 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:08.453692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:08.455299 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:08.599062 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:08.612973 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2510eb3e-a328-4f09-a731-af9bb52dae11 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.174317 Aug 18 20:55:08.634114 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 110/209] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:08 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:09.640036 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:09.640855 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:09.650219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:09.650927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:09.651584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:09.652507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:09.653262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:09.654068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:09.691928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:09.692527 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:09.705697 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:09.709354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:09.709835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:09.712811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:09.713289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:09.713886 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:09.734297 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] HTTP exception thrown: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Request method failure captured: Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 HTTP/1.1 Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGYjs9rcyFxgjoXBaCf-NX8qjP79_PXMuP9cK_eOGmBk5LgVe_w6fAdY6NrAc9WUGe9i_SRPhRvC8cflquZ5MNv5b_evQQtqGaXF1JVdPG4g3kQvVdEV-E-e4giBA8ssaMEGs_mT3ywwOlaxP0Uvy3auQhM6-1tFxvBP1_zzssjxw Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:55:09.736903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7a536708296847aeb7a88156d077da60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7a536708296847aeb7a88156d077da60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 41b8a21b3d0747c68eda9f991d735772 Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.738120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '629e5883-6808-4193-8639-e5461fc0ce76'} Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:55:09.738775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.739855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.741187 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Returning 404 to user: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:55:09.741187 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-160bb121-7522-4c25-b178-76b2813751f1 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "DELETE /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 404 len: 111 microversion: 2.1 time: 0.051784 Aug 18 20:55:09.743255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 111/210] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 20:55:09 2022] DELETE /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 20:55:09.748741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:09.749455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] [instance: 629e5883-6808-4193-8639-e5461fc0ce76] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:09.756572 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:09.757203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:09.757917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:09.759866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:09.760741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:09.761218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:09.777668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] HTTP exception thrown: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Request method failure captured: Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 HTTP/1.1 Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGYjs9rcyFxgjoXBaCf-NX8qjP79_PXMuP9cK_eOGmBk5LgVe_w6fAdY6NrAc9WUGe9i_SRPhRvC8cflquZ5MNv5b_evQQtqGaXF1JVdPG4g3kQvVdEV-E-e4giBA8ssaMEGs_mT3ywwOlaxP0Uvy3auQhM6-1tFxvBP1_zzssjxw Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:55:09.779269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7a536708296847aeb7a88156d077da60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7a536708296847aeb7a88156d077da60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7a536708296847aeb7a88156d077da60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 7a536708296847aeb7a88156d077da60 Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-DeleteServersTestJSON-880189846 Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 41b8a21b3d0747c68eda9f991d735772 Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-DeleteServersTestJSON-880189846-project Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.780850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '629e5883-6808-4193-8639-e5461fc0ce76'} Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:55:09.781666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. Aug 18 20:55:09.783378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:55:09.788081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] Returning 404 to user: Instance 629e5883-6808-4193-8639-e5461fc0ce76 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:55:09.788081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-385498df-70dc-4be6-a05e-0d02f4f39834 tempest-DeleteServersTestJSON-880189846 tempest-DeleteServersTestJSON-880189846-project] 10.222.0.62 "GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76" status: 404 len: 111 microversion: 2.1 time: 0.037804 Aug 18 20:55:09.788371 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 112/211] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:09 2022] GET /compute/v2.1/servers/629e5883-6808-4193-8639-e5461fc0ce76 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:55:10.114379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:10.145005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-59c51e3b-a835-44c5-825b-621e3e7182a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.503552 Aug 18 20:55:10.146239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 100/212] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:09 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:11.167531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:11.168255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:11.175818 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:11.176496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:11.177233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:11.178157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:11.178835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:11.179315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:11.579730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:11.587998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0690c58d-31ab-47ac-8938-e47e922730b6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.424728 Aug 18 20:55:11.598981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 113/213] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:11 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:12.612371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:12.613776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:12.638990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:12.638990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:12.638990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:12.638990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:12.639323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:12.639323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:12.934621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:12.942755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-27742646-560d-4224-b1bd-6cb76ae2c95c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.337244 Aug 18 20:55:12.943493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 101/214] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:12 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:13.963973 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:13.965270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:13.972483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:13.972966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:13.973630 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:13.974349 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:13.974814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:13.975244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:14.145851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:14.158188 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7cd87743-2d40-421d-9773-0cd2264fddfc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.198317 Aug 18 20:55:14.172350 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 114/215] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:13 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:15.180257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:15.182382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:15.190956 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:15.191735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:15.192354 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:15.193218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:15.193856 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:15.194437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:15.450779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:15.465291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1da73cff-4581-48ce-99bb-ae2ba3bce330 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.289446 Aug 18 20:55:15.466299 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 102/216] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:15 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:15.598740 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1393651418", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:15.674095 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.network.neutron [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] validate_networks() for None {{(pid=127936) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:55:16.332345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Flavor limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:55:16.332847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Image limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:55:16.333443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Flavor pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:55:16.333952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Image pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:55:16.334486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:55:16.345353 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:16.345946 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:16.346478 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:16.347300 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:16.347873 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:16.348394 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:16.392606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Getting quotas for project a616fee258c14f1289fb10ecc7354067. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:55:16.403537 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Getting quotas for user 24bcdddbaba14098b3c12bbc679f988d and project a616fee258c14f1289fb10ecc7354067. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:55:16.428465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Going to run 1 instances... {{(pid=127936) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:55:16.431970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127936) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:55:16.487952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:16.488590 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:16.497520 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:16.498046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:16.506092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:16.506092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:16.506092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:16.506092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:16.660637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:16.668697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6e5b76ca-bbbd-45fa-a7ec-149f1f7a9a79 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.185783 Aug 18 20:55:16.670848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 103/217] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:16 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:16.695426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-82553f42-5274-4d4a-a602-b1443468b093 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102535 Aug 18 20:55:16.697109 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 115/218] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:55:16.707763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6f153804-252d-4c52-9a7d-58042e111195 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:16.708611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6f153804-252d-4c52-9a7d-58042e111195 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:16.781624 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6f153804-252d-4c52-9a7d-58042e111195 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:16.790032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6f153804-252d-4c52-9a7d-58042e111195 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1215 microversion: 2.1 time: 0.085988 Aug 18 20:55:16.790697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 104/219] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:16 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:17.693730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:17.694511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:17.707642 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:17.707642 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:17.707642 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:17.708829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:17.709939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:17.710838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:17.823498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a82c203b-a49c-4036-8b17-d4c173ab18a7 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:17.828000 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a82c203b-a49c-4036-8b17-d4c173ab18a7 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:17.896017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:17.904130 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3ee48656-43ff-4759-a3e0-1b67fe166cf2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.216365 Aug 18 20:55:17.913032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 116/220] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:17 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:17.932854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a82c203b-a49c-4036-8b17-d4c173ab18a7 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:17.942932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a82c203b-a49c-4036-8b17-d4c173ab18a7 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1215 microversion: 2.1 time: 0.128392 Aug 18 20:55:17.943861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 105/221] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:17 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:18.933706 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:18.934452 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:18.944328 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:18.946982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:18.946982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:18.946982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:18.946982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:18.947757 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:18.965997 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:18.966636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:18.982470 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:18.990136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:18.990984 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:19.007747 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:19.010514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:19.012248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:19.105770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:19.128551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-826c8450-d068-429d-a42b-62e4490e7cc1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1219 microversion: 2.1 time: 0.168156 Aug 18 20:55:19.130026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 106/222] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:18 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:19.216061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:19.228144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bca087d7-4558-470c-b89d-9b64d47885ac tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.298975 Aug 18 20:55:19.231560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 117/223] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:18 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:20.149649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:20.150260 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:20.156889 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:20.158412 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:20.158981 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:20.159991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:20.160587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:20.161144 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:20.231083 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:20.238763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f6faa062-5d78-4d86-ae30-134fa965d367 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1211 microversion: 2.1 time: 0.092973 Aug 18 20:55:20.239559 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 107/224] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:20 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:20.252066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:20.252066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:20.258546 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:20.259038 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:20.259625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:20.262700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:20.262700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:20.262700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:20.394927 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:20.420471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-27bf5034-5b09-4ebf-b857-0e53709935a6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.173697 Aug 18 20:55:20.421658 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 118/225] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:20 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:21.262569 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:21.263264 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:21.272874 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:21.273371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:21.273811 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:21.274534 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:21.275938 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:21.275938 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:21.445000 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:21.445624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:21.455487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:21.455487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:21.455487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:21.455487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:21.455830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:21.456248 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:21.527622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:21.539083 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ad8cd6cc-83ef-47d8-9dbb-a38e6e36f32c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1211 microversion: 2.1 time: 0.283907 Aug 18 20:55:21.552729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 108/226] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:21 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1211 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:21.608771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:21.617675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-28de10d1-1417-4b4f-bf2e-d8e22078c17f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.179728 Aug 18 20:55:21.618378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 119/227] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:21 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:22.563095 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:22.564816 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:22.573832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:22.574320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:22.574749 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:22.575700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:22.576345 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:22.576903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:22.640996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:22.642406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:22.651641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:22.652865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:22.653763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:22.655132 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:22.655306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:22.657692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:22.658730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:22.669412 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8e0bc27a-2b57-4e7f-b5fd-6b99a0f9e0a1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1211 microversion: 2.1 time: 0.112757 Aug 18 20:55:22.670369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 109/228] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:22 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:22.696499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:22.872298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:22.882945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-274179c1-c0c4-418b-81de-dd8e906648cf tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.246372 Aug 18 20:55:22.883574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 120/229] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:22 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:23.703353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:23.704549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:23.706957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=54 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:23.711913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:23.712388 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:23.712813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:23.713540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:23.713983 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:23.714400 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:23.777873 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:23.785738 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c42551c5-cc6a-4392-911c-01ad06e13eaf tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1211 microversion: 2.1 time: 0.086386 Aug 18 20:55:23.786293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 110/230] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:23 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:23.909352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:23.909971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:23.920067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:23.920911 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:23.921594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:23.923316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:23.927774 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:23.928306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:24.119676 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:24.142519 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4b86480a-816e-483b-9efa-f9ef62fa0f34 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1521 microversion: 2.1 time: 0.237439 Aug 18 20:55:24.143403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 121/231] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:23 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:24.807214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:24.807937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:24.820108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:24.820611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:24.821050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:24.821764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:24.822216 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:24.822642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:24.953001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:24.964229 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-356897b3-f37e-4392-b454-8c16a7a352b6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1275 microversion: 2.1 time: 0.161802 Aug 18 20:55:24.979754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 111/232] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:24 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:25.166450 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:25.172448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:25.198791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:25.199289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:25.199760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:25.208166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:25.209034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:25.209745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:25.629842 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:25.658654 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-fcf81c94-3f51-4c51-8489-0b442fe42acc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1501 microversion: 2.1 time: 0.497384 Aug 18 20:55:25.661729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 122/233] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:25 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1501 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:25.684963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:25.685586 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:25.692841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:25.693835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:25.694277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:25.694986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:25.695482 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:25.695952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:25.859501 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:25.870259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7310e059-e4bf-404c-9c4e-2dd1487f464e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1515 microversion: 2.1 time: 0.188651 Aug 18 20:55:25.870548 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 112/234] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:25 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:25.874855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f56effb1-9ec1-43e2-b20e-9e8ea120a808 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'create', calling method: .version_select at 0x7f8b5adea5e0>, body: {"keypair": {"name": "tempest-keypair-1458978149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvTtNmbb+eqiiuo+IZ4wsfAgS0KxrfDuPeZBRPhsb4OXSf7rWDWfSgn+9tzdCdy7t3xYb29gvd2F+6mDcCtjV2vigtyXDOB+IQj9v2pMkb4hVKGEyIwE7aA2zZGA1HDBA=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:25.901287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-f56effb1-9ec1-43e2-b20e-9e8ea120a808 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for project 4600f776fb78446ab25a3ee913934fcc. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:55:25.905550 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-f56effb1-9ec1-43e2-b20e-9e8ea120a808 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for user cf3712f97958438581b8e153723a1d71 and project 4600f776fb78446ab25a3ee913934fcc. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:55:25.986200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:25.986820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:25.992718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:25.993203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:25.993639 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:25.994335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:25.994791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:25.995219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:26.042573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f56effb1-9ec1-43e2-b20e-9e8ea120a808 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.331300 Aug 18 20:55:26.043252 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 123/235] 10.222.0.62 () {62 vars in 1200 bytes} [Thu Aug 18 20:55:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 333 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 20:55:26.076942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:26.080482 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:26.085365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e8cc2c7b-8ca8-4a4e-93c2-68fef754afcd tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1273 microversion: 2.1 time: 0.103018 Aug 18 20:55:26.085975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 113/236] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:25 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:27.113668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:27.114303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:27.116340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:27.123181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:27.123723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:27.124164 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:27.124889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:27.129612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:27.130155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:27.532478 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:27.551737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6adc155f-4f9a-493a-b4be-9ef4c5a5f497 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.440061 Aug 18 20:55:27.551737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 124/237] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:27 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:28.571057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:28.571708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:28.575617 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=4 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:28.580171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:28.580910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:28.581506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:28.582373 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:28.582974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:28.583648 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:28.751937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:28.762939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-185269ea-0e8b-446b-873e-5f7f4ec92c17 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.195536 Aug 18 20:55:28.763998 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 114/238] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:28 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:29.025562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-5276eb79-f411-4425-8453-cb2c928c6177 req-1df65b03-d152-4008-a45e-d4ba573ba2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b40b497-83cf-4d49-8055-d89433cef13f", "tag": "0e50a326-ea72-4d93-ae78-d5ada7a0b57e"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:29.042965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-5276eb79-f411-4425-8453-cb2c928c6177 req-1df65b03-d152-4008-a45e-d4ba573ba2b0 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:29.043516 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-5276eb79-f411-4425-8453-cb2c928c6177 req-1df65b03-d152-4008-a45e-d4ba573ba2b0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:29.043961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-5276eb79-f411-4425-8453-cb2c928c6177 req-1df65b03-d152-4008-a45e-d4ba573ba2b0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:29.072540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-5276eb79-f411-4425-8453-cb2c928c6177 req-1df65b03-d152-4008-a45e-d4ba573ba2b0 service nova] Creating event network-changed:0e50a326-ea72-4d93-ae78-d5ada7a0b57e for instance 4b40b497-83cf-4d49-8055-d89433cef13f on hv-cinder-85265 Aug 18 20:55:29.083608 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-5276eb79-f411-4425-8453-cb2c928c6177 req-1df65b03-d152-4008-a45e-d4ba573ba2b0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068762 Aug 18 20:55:29.086026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 125/239] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:55:29.352616 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:29.356326 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:29.364112 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:29.373028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:29.373028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:29.373028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:29.373028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:29.373511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:29.403470 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lazy-loading 'flavor' on Instance uuid df6d725b-6c0e-43f3-b240-99f9a739d63f {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:55:29.786617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:29.790451 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:29.802823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:29.803332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:29.803781 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:29.807182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:29.807920 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:29.810576 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:30.210653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:30.225804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-daf8ae66-72c0-4fb4-9c4d-1eb1f716ad62 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.444403 Aug 18 20:55:30.226714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 126/240] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:29 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:30.254629 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f576003d-945b-473f-b212-7b2c26365ab5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f/action" status: 200 len: 32 microversion: 2.1 time: 0.911164 Aug 18 20:55:30.255657 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 115/241] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 20:55:29 2022] POST /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f/action => generated 32 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 20:55:30.267315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:30.268706 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:30.286767 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:30.287858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:30.290288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:30.291523 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:30.296070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:30.297107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:30.701559 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:30.718962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-70b6dce1-9345-4b17-b5ba-1e9307e208f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.456588 Aug 18 20:55:30.720744 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 127/242] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:30 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:31.031460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2075972464", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18e2e06f-6daf-4f2e-8339-d1cb00af2b1b"}], "security_groups": [{"name": "tempest-securitygroup--263153611"}], "key_name": "tempest-keypair-1458978149", "user_data": "}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:31.214029 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] validate_networks() for [('18e2e06f-6daf-4f2e-8339-d1cb00af2b1b', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:55:31.246730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:31.251585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:31.251585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:31.254981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:31.255723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:31.256240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:31.257182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:31.257832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:31.258528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:31.459036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:31.471727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-58c3ab55-fbb6-44f7-9d2a-39d18969d193 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.227141 Aug 18 20:55:31.471727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 128/243] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:31 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:31.715791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:55:31.716409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:55:31.716786 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:55:31.717304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:55:31.717757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:55:31.727813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:31.728358 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:31.728723 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:31.729783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:31.730241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:31.730824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:31.744986 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:31.746278 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:31.752077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for project 4600f776fb78446ab25a3ee913934fcc. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:55:31.755306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:31.756280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:31.756890 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for user cf3712f97958438581b8e153723a1d71 and project 4600f776fb78446ab25a3ee913934fcc. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:55:31.757029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:31.757850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:31.758358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:31.759419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:31.771117 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:55:31.774145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:55:32.074355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:32.074355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ad735fbd-152c-4ec3-abbb-28e185c23955 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.178798 Aug 18 20:55:32.074355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 129/244] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:31 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:32.250137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6bf90ec2-0cb2-4958-bdae-18417c7888bb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.226130 Aug 18 20:55:32.250137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 116/245] 10.222.0.62 () {62 vars in 1188 bytes} [Thu Aug 18 20:55:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 20:55:32.260611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b86cfb5e-726c-44ac-9510-db3b6534e12c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:32.261233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b86cfb5e-726c-44ac-9510-db3b6534e12c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:32.382485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b86cfb5e-726c-44ac-9510-db3b6534e12c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:32.390590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b86cfb5e-726c-44ac-9510-db3b6534e12c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:32.392682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b86cfb5e-726c-44ac-9510-db3b6534e12c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:32.394270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b86cfb5e-726c-44ac-9510-db3b6534e12c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1282 microversion: 2.20 time: 0.138666 Aug 18 20:55:32.395347 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 130/246] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:32 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:32.490833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:32.491467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:32.498632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:32.499117 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:32.499811 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:32.500516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:32.501033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:32.501445 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:32.660367 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:32.668498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-85828c73-7ba0-41be-bb0b-5a1767435a35 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.181562 Aug 18 20:55:32.671743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 117/247] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:32 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:33.082714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:33.085256 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:33.096021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:33.096515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:33.096946 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:33.103177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:33.103853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:33.104339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:33.333336 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:33.347235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-99402b66-2206-4e77-b6c3-de5d6a74c414 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.275211 Aug 18 20:55:33.363577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 131/248] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:33 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:33.417636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-61ffa485-303c-4bbb-946d-38a6cd009921 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:33.419396 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-61ffa485-303c-4bbb-946d-38a6cd009921 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:33.486451 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-61ffa485-303c-4bbb-946d-38a6cd009921 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:33.496637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-61ffa485-303c-4bbb-946d-38a6cd009921 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:33.501903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-61ffa485-303c-4bbb-946d-38a6cd009921 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:33.501903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-61ffa485-303c-4bbb-946d-38a6cd009921 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1282 microversion: 2.20 time: 0.088368 Aug 18 20:55:33.502380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 118/249] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:33 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1282 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:33.691416 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:33.692745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:33.703554 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:33.704391 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:33.705532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:33.706257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:33.706709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:33.707131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:33.873707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:33.883440 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d5446424-830b-40ae-a09f-cbcaf9d546de tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.197683 Aug 18 20:55:33.884035 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 132/250] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:33 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:34.371228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:34.373677 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:34.381196 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:34.381700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:34.382126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:34.382916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:34.383560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:34.383817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:34.527570 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:34.528708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:34.537977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:34.542985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:34.542985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:34.542985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:34.542985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:34.543344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:34.550476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:34.566617 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c04c0764-a532-4035-a7f1-7de134fea52f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.198962 Aug 18 20:55:34.567726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 119/251] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:34 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:34.646530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:34.656986 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:34.659031 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:34.660165 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a3ba7919-c328-46a3-9084-6c22404fe7aa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1278 microversion: 2.20 time: 0.139782 Aug 18 20:55:34.660718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 133/252] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:34 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:55:34.908581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:34.909339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:34.915689 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:34.916174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:34.916659 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:34.917823 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:34.917823 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:34.918175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:35.091182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:35.100324 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e34b768d-d44c-4ed2-bb0c-4738e629edb1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.196305 Aug 18 20:55:35.107270 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 120/253] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:34 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:35.602577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:35.603199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:35.612799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:35.614162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:35.614848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:35.621424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:35.621424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:35.621424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:35.687851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:35.689301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:35.699719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:35.700633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:35.701661 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:35.702685 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:35.703147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:35.703627 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:35.775550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:35.785007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:35.786678 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:35.787937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0e78fa47-ac98-45a4-be58-c2449d8b80d3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1352 microversion: 2.20 time: 0.104817 Aug 18 20:55:35.788503 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 121/254] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:35 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:55:35.831175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:35.841186 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-49b8ca27-ae7e-4b4c-bfc9-05ad733d254d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.242684 Aug 18 20:55:35.852266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 134/255] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:35 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:36.122803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:36.123495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:36.129756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:36.130238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:36.130672 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:36.131386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:36.131937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:36.132638 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:36.306511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:36.314856 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7630474a-143e-412c-bc3d-268dce95ada4 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.195903 Aug 18 20:55:36.328204 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 122/256] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:36 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:36.817785 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:36.818432 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:36.826037 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:36.826614 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:36.827081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:36.827934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:36.828420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:36.829357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:36.883505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:36.884696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:36.894888 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:36.895427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:36.896031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:36.896762 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:36.897215 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:36.897813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:37.080121 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:37.098003 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:37.103026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:37.103590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:37.106489 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-44d2930c-7227-40f0-923c-86710d881a7a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.293873 Aug 18 20:55:37.109278 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 135/257] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:36 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:37.109598 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ce74b6de-7c61-4f56-a98b-d539d7bb9db6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.229524 Aug 18 20:55:37.119476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 123/258] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:36 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:37.336956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:37.337866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:37.351153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:37.354175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:37.354634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:37.355435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:37.356386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:37.360144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:37.504119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-210bb22a-b7e7-4b77-a12d-2d2d47b11845 req-1c62120f-d139-4653-b27a-50cdc59f6d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b40b497-83cf-4d49-8055-d89433cef13f", "name": "network-vif-plugged", "status": "completed", "tag": "0e50a326-ea72-4d93-ae78-d5ada7a0b57e"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:37.525876 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-210bb22a-b7e7-4b77-a12d-2d2d47b11845 req-1c62120f-d139-4653-b27a-50cdc59f6d42 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:37.526672 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-210bb22a-b7e7-4b77-a12d-2d2d47b11845 req-1c62120f-d139-4653-b27a-50cdc59f6d42 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:37.528445 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-210bb22a-b7e7-4b77-a12d-2d2d47b11845 req-1c62120f-d139-4653-b27a-50cdc59f6d42 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:37.551680 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-210bb22a-b7e7-4b77-a12d-2d2d47b11845 req-1c62120f-d139-4653-b27a-50cdc59f6d42 service nova] Creating event network-vif-plugged:0e50a326-ea72-4d93-ae78-d5ada7a0b57e for instance 4b40b497-83cf-4d49-8055-d89433cef13f on hv-cinder-85265 Aug 18 20:55:37.559607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-210bb22a-b7e7-4b77-a12d-2d2d47b11845 req-1c62120f-d139-4653-b27a-50cdc59f6d42 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060785 Aug 18 20:55:37.560920 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 124/259] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:55:37.652313 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:37.664015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-922a2f98-7393-47e4-89f5-9b8291487f40 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.331231 Aug 18 20:55:37.664741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 136/260] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:37 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:38.032782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-d5025dfb-7cc6-4e41-9baa-20265fdab3df req-9b27f657-1b2c-453c-b081-412829d46c69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c76af8-35e8-4dbe-885d-cb5510af2411", "tag": "2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:38.043073 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-d5025dfb-7cc6-4e41-9baa-20265fdab3df req-9b27f657-1b2c-453c-b081-412829d46c69 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:38.046692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-d5025dfb-7cc6-4e41-9baa-20265fdab3df req-9b27f657-1b2c-453c-b081-412829d46c69 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:38.046692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-d5025dfb-7cc6-4e41-9baa-20265fdab3df req-9b27f657-1b2c-453c-b081-412829d46c69 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:38.055892 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-d5025dfb-7cc6-4e41-9baa-20265fdab3df req-9b27f657-1b2c-453c-b081-412829d46c69 service nova] Creating event network-changed:2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca for instance 36c76af8-35e8-4dbe-885d-cb5510af2411 on hv-cinder-85265 Aug 18 20:55:38.060790 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-d5025dfb-7cc6-4e41-9baa-20265fdab3df req-9b27f657-1b2c-453c-b081-412829d46c69 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033669 Aug 18 20:55:38.061401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 125/261] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:55:38.148723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:38.148723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:38.149481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:38.149481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:38.156161 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:38.156527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:38.156808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:38.157288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:38.158130 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:38.158387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:38.158784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:38.158882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:38.159208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:38.159799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:38.160371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:38.160973 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:38.309876 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:38.317684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fd67482f-6fda-470f-ab49-adae018ea2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.177439 Aug 18 20:55:38.327179 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 126/262] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:38 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:38.327429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:38.332932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:38.334438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:38.335703 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cb65ee56-4eea-4eea-9680-c7b1dda4b342 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.203817 Aug 18 20:55:38.336287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 137/263] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:38 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:38.692450 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:38.693066 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:38.699266 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:38.699834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:38.700275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:38.701007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:38.701463 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:38.701890 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:38.853548 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:38.854343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7621fb73-3b0c-4e82-8c15-381882a4aee6 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.166192 Aug 18 20:55:38.854915 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 127/264] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:38 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:39.339976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:39.340822 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:39.348852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:39.349338 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:39.350175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:39.353256 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:39.354303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:39.355232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:39.363060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:39.365203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:39.376566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:39.377570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:39.378344 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:39.379344 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:39.380356 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:39.381044 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:39.539531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:39.549605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:39.551231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:39.552603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9f44dea2-0194-461e-9bc2-dea6795bf73c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.194644 Aug 18 20:55:39.553204 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 128/265] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:39 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:39.575680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:39.583829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8f36e1e8-3a7c-4386-8aa7-887ad192c9de tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.247966 Aug 18 20:55:39.584401 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 138/266] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:39 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:39.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:39.877504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:39.884010 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:39.884800 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:39.885527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:39.886427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:39.887056 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:39.887518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:40.035949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:40.043652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e1cd69b4-f455-461a-a676-cb64cc36e06e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1315 microversion: 2.1 time: 0.171069 Aug 18 20:55:40.044226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 129/267] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:39 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:40.575516 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:40.576830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:40.582919 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:40.583518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:40.584447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:40.585228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:40.585907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:40.586363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:40.610051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:40.610051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:40.615404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:40.617792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:40.618324 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:40.619404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:40.620115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:40.621174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:40.623517 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:40.762254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:40.771047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:40.775330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:40.776532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d6327930-7734-4d33-9f1a-6ec6b4b18d0b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.205834 Aug 18 20:55:40.777418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 139/268] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:40 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:40.806706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:40.816878 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-63730a6f-8589-4576-a4c7-be50ce5c6b25 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.214758 Aug 18 20:55:40.817456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 130/269] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:40 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:41.064859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:41.065461 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:41.071436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.071921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.072377 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.073063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.073511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.073933 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.215987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:41.224250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-45e99a52-d95e-482f-88a3-1c68ddd3c4ed tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1465 microversion: 2.1 time: 0.163216 Aug 18 20:55:41.224826 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 140/270] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:41 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1465 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:41.271543 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:41.272041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:41.277961 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.278437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.278868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.279594 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.280045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.280468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.310971 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:41.317089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Going to try to terminate instance {{(pid=127937) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 20:55:41.708602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fa321228-3dc9-4863-a234-c15cf1b0e123 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 204 len: 0 microversion: 2.1 time: 0.441121 Aug 18 20:55:41.709189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 131/271] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 20:55:41 2022] DELETE /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 20:55:41.717242 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:41.719649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:41.724620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.725131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.725571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.726316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.726776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.727254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.801167 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:41.801986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:41.814247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:41.816117 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.816611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.817050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.817762 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.818223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.818647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.881798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:41.891507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0640ae6d-e18e-4d64-97e3-59cd00f8184e tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.177912 Aug 18 20:55:41.892907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 141/272] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:41 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:41.897855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:41.898774 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:41.905066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.905584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.906025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.906724 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:41.907179 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:41.907664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:41.989858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:42.012795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:42.014302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:42.015482 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-75ef7562-bb74-4e12-9e09-e010d773a1a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.219359 Aug 18 20:55:42.016049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 132/273] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:41 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:55:42.058196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:42.066779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bf010386-c824-4b7b-a97b-a92e83cafcc0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.172873 Aug 18 20:55:42.067399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 142/274] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:41 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:42.915232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:42.916883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:42.930961 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:42.932636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:42.934134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:42.935632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:42.947900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:42.947900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:43.036036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=12 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:43.043808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:43.044862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:43.063335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:43.064413 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:43.064983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:43.068592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:43.069241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:43.069827 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:43.111121 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:43.119931 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2b9508f6-f861-41bb-8f33-18cee9b652fa tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.209636 Aug 18 20:55:43.120733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 133/275] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:42 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:43.135905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:43.136544 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:43.144145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:43.144654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:43.145294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:43.146189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:43.146815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:43.147496 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:43.327233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:43.340494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:43.341077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:43.356636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:43.361403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6b3dceea-de8e-4f92-8ee3-b39beab4b28b tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.238734 Aug 18 20:55:43.362205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b88fa1e7-2010-469b-b8fe-95570bd20363 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.322886 Aug 18 20:55:43.362313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 134/276] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:43 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:43.362976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 143/277] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:43 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:55:44.143403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:44.146520 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:44.146520 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=8 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:44.152172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:44.152670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:44.153100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:44.153808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:44.154258 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:44.154675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:44.360205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:44.384552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:44.385175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:44.393311 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:44.394424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:44.399257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:44.399257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:44.400493 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:44.401350 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:44.405299 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2ad1cac6-e56e-4901-b0eb-c18dc42c23d8 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.266951 Aug 18 20:55:44.418561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 135/278] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:44 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:44.426357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:44.427125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:44.434462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:44.435165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:44.435706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:44.436531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:44.437062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:44.437561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:44.619822 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:44.629464 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:44.631191 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:44.632637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7c2a147e-ed88-4314-b1be-b95ae606938a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.212703 Aug 18 20:55:44.633442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 136/279] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:44 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:44.729240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:44.741932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1da8215a-3a4d-4fab-b3e4-2d44c0d2a3a9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.362603 Aug 18 20:55:44.742528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 144/280] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:44 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:45.430021 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:45.430660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:45.438291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:45.439389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:45.439827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:45.440536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:45.440998 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:45.441419 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:45.574547 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:45.583128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b8e5c3b5-f19c-481a-aa32-35ded8296a76 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.156895 Aug 18 20:55:45.583761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 137/281] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:45 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:45.661246 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:45.661858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:45.668020 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:45.668504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:45.668932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:45.669632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:45.670070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:45.670490 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:45.765541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:45.766248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:45.772905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:45.773313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:45.773768 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:45.774481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:45.774926 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:45.775391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:45.804905 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:45.813660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:45.815758 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:45.816885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b241fb76-5051-4958-9d01-f9b01e4ea54f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.159592 Aug 18 20:55:45.817645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 145/282] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:45 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:45.906826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:45.914631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-755a3abc-61a2-4aaf-9bc7-abb40f31755c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.152928 Aug 18 20:55:45.915210 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 138/283] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:45 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:46.611262 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:46.611903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:46.617892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:46.618389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:46.618824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:46.619608 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:46.619998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:46.620518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:46.764107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:46.772808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-666f0950-45c2-4ca3-8ebf-a99fa90b625d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.165534 Aug 18 20:55:46.773266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 146/284] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:46 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:46.838195 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:46.838796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:46.846030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:46.846554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:46.846988 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:46.847702 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:46.848149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:46.848568 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:46.935634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:46.936241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:46.942673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:46.943157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:46.943672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:46.944607 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:46.945230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:46.945817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:46.990465 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:46.999230 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:47.001140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:47.002268 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e93febe6-a08c-471b-8991-5ca9c18bc1f8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.168055 Aug 18 20:55:47.002833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 139/285] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:46 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:47.077228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:47.085216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cacda13f-c533-4caf-b8fa-457945950139 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.153368 Aug 18 20:55:47.085757 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 147/286] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:46 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:47.794693 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:47.795301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:47.801295 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:47.801776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:47.802206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:47.802895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:47.803349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:47.803796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:47.937298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:47.945782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-86f9c498-5433-4c1a-9e40-c179d3cc0cc9 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.155064 Aug 18 20:55:47.946348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 140/287] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:47 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:48.024666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:48.025276 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:48.031502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:48.031991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:48.032432 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:48.033128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:48.033580 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:48.034005 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:48.106141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:48.106758 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:48.113805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:48.114293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:48.114727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:48.115481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:48.115936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:48.116362 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:48.170460 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:48.180578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:48.182267 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:48.183935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-06afb816-66c6-47f0-87c8-26f7e0c04840 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.163132 Aug 18 20:55:48.184582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 148/288] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:48 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:48.259544 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:48.267702 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b895c4eb-d934-469f-9565-911b8e7fde28 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.165401 Aug 18 20:55:48.268285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 141/289] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:48 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:48.970403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:48.971599 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:48.981814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:48.982700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:48.983527 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:48.984406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:48.984848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:48.985278 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:49.123594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:49.132902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-118a8d75-c9bc-4fb7-a8fd-5c997be47a86 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.169806 Aug 18 20:55:49.133461 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 149/290] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:48 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:49.206438 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:49.207059 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:49.213685 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:49.214169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:49.214605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:49.215298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:49.215782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:49.216206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:49.290097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:49.290926 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:49.297837 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:49.298963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:49.299498 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:49.300279 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:49.301119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:49.301896 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:49.370899 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:49.380354 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:49.381812 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:49.382911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8f605a4b-41a5-45ab-8d09-7c8f7e4abd5b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.180410 Aug 18 20:55:49.383509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 142/291] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:49 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:49.445805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:49.453650 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f2499dff-2bb2-4bed-ab6d-91a8f23bc24e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.167745 Aug 18 20:55:49.454864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 150/292] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:49 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:50.153928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:50.154541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:50.161910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:50.161910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:50.162274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:50.163016 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:50.163499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:50.163928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:50.292155 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:50.299906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ac9e7ec6-26a2-4aed-9e1d-e6fd6cbe7d9a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.149895 Aug 18 20:55:50.300468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 143/293] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:50 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:50.405931 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:50.406540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:50.413155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:50.413643 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:50.414083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:50.414769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:50.415225 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:50.415680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:50.475585 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:50.476322 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:50.482649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:50.483257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:50.483722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:50.484440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:50.484888 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:50.485308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:50.551559 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:50.559926 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:50.561417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:50.562652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e76a7c05-e98b-4203-9c1c-c4d5b6b73a3f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.160607 Aug 18 20:55:50.563520 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 151/294] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:50 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:50.617290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:50.625060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-121f1061-f3fe-4d5d-9420-7441af7911d0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.153336 Aug 18 20:55:50.625618 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 144/295] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:50 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:51.321288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:51.321944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:51.328996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:51.329491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:51.329936 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:51.330634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:51.331077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:51.331525 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:51.481474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:51.490813 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-317ee106-f59d-44cf-9064-85bd21abf8fe tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.173342 Aug 18 20:55:51.491403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 152/296] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:51 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:51.589944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:51.591122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:51.603689 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:51.609122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:51.609122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:51.609122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:51.609122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:51.609485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:51.646802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:51.647898 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:51.654786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:51.655851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:51.656436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:51.660983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:51.662089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:51.662872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:51.790669 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:51.802088 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:51.803969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:51.805208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1592439d-fc22-4a76-bcff-6a0e1cbcc263 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.222750 Aug 18 20:55:51.805855 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 145/297] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:51 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:55:51.822118 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:51.830377 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d0045db1-bbc6-4b75-a165-60966471c9df tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.187907 Aug 18 20:55:51.830866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 153/298] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:51 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:52.512659 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:52.513297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:52.520359 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:52.520847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:52.521280 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:52.521987 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:52.522435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:52.522859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:52.541967 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:52.668736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:52.677380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1486690a-7c72-49b1-b28c-dbcdde0e9aa1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.168506 Aug 18 20:55:52.677959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 146/299] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:52 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:52.828335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:52.829044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:52.835212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:52.835735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:52.836253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:52.837024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:52.837487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:52.837998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:52.852362 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:52.853258 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:52.861919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:52.862324 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:52.862760 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:52.863493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:52.864057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:52.864449 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:53.006455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:53.026747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:53.032624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:53.035284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5bf4216d-c2ac-4f1f-bfc0-c6b8b549c4d6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.210694 Aug 18 20:55:53.041649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 154/300] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:52 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:53.089401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:53.105546 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-89735535-7f90-42fa-9633-11f30f087e33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.257534 Aug 18 20:55:53.106120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 147/301] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:52 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:53.701866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:53.702497 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:53.709239 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:53.709760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:53.710297 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:53.711010 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:53.711564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:53.711999 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:53.861612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:53.874378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f981c746-8d03-438c-a7dc-72aeb4b330ef tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.176041 Aug 18 20:55:53.876137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 155/302] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:53 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:53.924075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-2b87afa2-250c-490b-ad8f-b7ca29134d5e req-8d00281e-1123-4d58-a7d9-395112523936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c76af8-35e8-4dbe-885d-cb5510af2411", "name": "network-vif-plugged", "status": "completed", "tag": "2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:53.928717 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.934712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2b87afa2-250c-490b-ad8f-b7ca29134d5e req-8d00281e-1123-4d58-a7d9-395112523936 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:53.935182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2b87afa2-250c-490b-ad8f-b7ca29134d5e req-8d00281e-1123-4d58-a7d9-395112523936 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:53.935640 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2b87afa2-250c-490b-ad8f-b7ca29134d5e req-8d00281e-1123-4d58-a7d9-395112523936 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:53.948524 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-2b87afa2-250c-490b-ad8f-b7ca29134d5e req-8d00281e-1123-4d58-a7d9-395112523936 service nova] Creating event network-vif-plugged:2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca for instance 36c76af8-35e8-4dbe-885d-cb5510af2411 on hv-cinder-85265 Aug 18 20:55:53.957831 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-2b87afa2-250c-490b-ad8f-b7ca29134d5e req-8d00281e-1123-4d58-a7d9-395112523936 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041318 Aug 18 20:55:53.958536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 148/303] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:55:54.067901 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:54.068918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:54.084979 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:54.087485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:54.088447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:54.089579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:54.090591 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:54.091463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:54.099246 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:54.131993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:54.133468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:54.145673 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:54.146484 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:54.147922 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:54.148670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:54.149689 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:54.150848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:54.408961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:54.419426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:54.422066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:54.424647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-266d6282-49b1-4846-8e5f-2001151830f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.361253 Aug 18 20:55:54.425869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 156/304] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:54 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:54.441648 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:54.456386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-74556b58-5b74-484f-a831-787302491973 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.332778 Aug 18 20:55:54.457410 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 149/305] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:54 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:54.902303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:54.902303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:54.907213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:54.908776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:54.909584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:54.910506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:54.911150 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:54.911935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:55.165910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-68424ee8-425d-4977-b4a1-7b526f226005 req-356a4d2a-19fb-4d26-9837-3e0314cb5202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b40b497-83cf-4d49-8055-d89433cef13f", "name": "network-vif-deleted", "tag": "0e50a326-ea72-4d93-ae78-d5ada7a0b57e"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:55.166387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:55.168884 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-68424ee8-425d-4977-b4a1-7b526f226005 req-356a4d2a-19fb-4d26-9837-3e0314cb5202 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:55.169375 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-68424ee8-425d-4977-b4a1-7b526f226005 req-356a4d2a-19fb-4d26-9837-3e0314cb5202 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:55.169806 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-68424ee8-425d-4977-b4a1-7b526f226005 req-356a4d2a-19fb-4d26-9837-3e0314cb5202 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:55.171168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2489e9d3-7d6f-4744-ae44-a51e36c9b856 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1471 microversion: 2.1 time: 0.278328 Aug 18 20:55:55.172101 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 157/306] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:54 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:55.182841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-68424ee8-425d-4977-b4a1-7b526f226005 req-356a4d2a-19fb-4d26-9837-3e0314cb5202 service nova] Creating event network-vif-deleted:0e50a326-ea72-4d93-ae78-d5ada7a0b57e for instance 4b40b497-83cf-4d49-8055-d89433cef13f on hv-cinder-85265 Aug 18 20:55:55.188489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-68424ee8-425d-4977-b4a1-7b526f226005 req-356a4d2a-19fb-4d26-9837-3e0314cb5202 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035886 Aug 18 20:55:55.189145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 150/307] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:55:55.453271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:55.453882 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:55.460662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:55.461238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:55.461675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:55.462376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:55.462828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:55.463255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:55.496315 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:55.497128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:55.504706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:55.505303 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:55.505805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:55.506617 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:55.507148 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:55.507684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:55.608465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:55.616945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:55.618761 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:55.620156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-fa9d72cb-fe1e-47d2-bd2d-d2eb9fa09702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.170916 Aug 18 20:55:55.620716 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 158/308] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:55 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:55:55.660570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:55.668801 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-98b08a22-16ec-4ec9-bc86-88d965961b45 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.176720 Aug 18 20:55:55.669384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 151/309] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:55 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:55.973772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-966ac20c-c620-4e37-a3fd-a0ca6e7d2d67 req-0d11d6cd-3b0d-4cee-a560-63099bcb26cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b40b497-83cf-4d49-8055-d89433cef13f", "name": "network-vif-unplugged", "status": "completed", "tag": "0e50a326-ea72-4d93-ae78-d5ada7a0b57e"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:55:55.983960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-966ac20c-c620-4e37-a3fd-a0ca6e7d2d67 req-0d11d6cd-3b0d-4cee-a560-63099bcb26cf service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:55.984621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-966ac20c-c620-4e37-a3fd-a0ca6e7d2d67 req-0d11d6cd-3b0d-4cee-a560-63099bcb26cf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:55.984930 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-966ac20c-c620-4e37-a3fd-a0ca6e7d2d67 req-0d11d6cd-3b0d-4cee-a560-63099bcb26cf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:55.998746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-966ac20c-c620-4e37-a3fd-a0ca6e7d2d67 req-0d11d6cd-3b0d-4cee-a560-63099bcb26cf service nova] Creating event network-vif-unplugged:0e50a326-ea72-4d93-ae78-d5ada7a0b57e for instance 4b40b497-83cf-4d49-8055-d89433cef13f on hv-cinder-85265 Aug 18 20:55:56.006560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-966ac20c-c620-4e37-a3fd-a0ca6e7d2d67 req-0d11d6cd-3b0d-4cee-a560-63099bcb26cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036770 Aug 18 20:55:56.007698 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 159/310] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:55:56.192692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:56.193233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:56.199680 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:56.200160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:56.200942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:56.201631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:56.202078 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:56.202503 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:56.263759 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:56.271667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-10345dc1-529f-4511-babd-8f08fe37a581 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1429 microversion: 2.1 time: 0.082876 Aug 18 20:55:56.272223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 152/311] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:56 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:56.643125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:56.643875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:56.650242 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:56.650721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:56.651159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:56.651866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:56.652318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:56.652787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:56.691013 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:56.691689 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:56.698001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:56.698769 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:56.699003 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:56.699764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:56.700222 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:56.700649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:56.787176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:56.796024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:56.797519 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:56.799171 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5c4d32f3-7505-44fb-9d22-9e71858fad96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.159863 Aug 18 20:55:56.800018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 160/312] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:56 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:56.842463 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:56.850254 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b57e990c-4936-4756-ac5e-d05fa96e3350 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.163935 Aug 18 20:55:56.850816 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 153/313] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:56 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:57.293230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:57.293928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:57.299793 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:57.300270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:57.300701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:57.301384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:57.301858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:57.302282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:57.368049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:57.375958 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2deff26f-4837-448f-b316-a7b3fb1acc56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1429 microversion: 2.1 time: 0.086570 Aug 18 20:55:57.376512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 161/314] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:57 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:57.821702 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:57.822328 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:57.830784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:57.831259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:57.832008 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:57.832732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:57.833768 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:57.834185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:57.871317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:57.871955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:57.878180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:57.878673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:57.879106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:57.888743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:57.888743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:57.888743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:57.965612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:57.974442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:57.975961 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:57.977141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d6bbe4d5-31f8-415a-8802-c328f603d354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.159817 Aug 18 20:55:57.977686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 154/315] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:57 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:58.015214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:58.023715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dceb6418-84ad-4bd6-aa21-22376014ce89 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.156152 Aug 18 20:55:58.024273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 162/316] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:57 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:58.396640 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:58.397251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:58.403247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:58.403781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:58.404216 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:58.404906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:58.405355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:58.405781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:58.467237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:58.475197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2dea5daa-d808-4c3d-a501-5450409b08d3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1429 microversion: 2.1 time: 0.082592 Aug 18 20:55:58.475929 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 155/317] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:58 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:55:58.999502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:59.000113 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:59.006176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:59.006662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:59.007654 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:59.009181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:59.009645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:59.010078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:59.045587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:59.046435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:59.053789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:59.055205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:59.055205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:59.056394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:59.056394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:59.056394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:59.164555 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:59.174767 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:59.176690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:59.178045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cc266a69-d910-4ab0-84fe-5180ffcb3328 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.182477 Aug 18 20:55:59.178949 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 163/318] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:55:58 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:55:59.397803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:59.405701 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9c62b43e-850c-43ca-bc2b-5885f6c4dd00 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.365097 Aug 18 20:55:59.406260 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 156/319] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:59 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:55:59.497115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:55:59.497666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:55:59.503638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:59.504126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:59.505075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:59.505767 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:55:59.506221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:55:59.506648 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:55:59.575632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:55:59.584552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f488f830-c495-420a-ab7f-b28509462b5d tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1429 microversion: 2.1 time: 0.091311 Aug 18 20:55:59.588193 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 164/320] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:55:59 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1429 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:00.206546 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:00.207478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:00.214756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:00.215307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:00.215772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:00.216505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:00.216959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:00.217404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:00.358303 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:00.366970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:00.368514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:00.369622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5bfb139c-3a50-47d7-a5d6-469db3345fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.167494 Aug 18 20:56:00.370193 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 157/321] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:00 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:56:00.425882 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:00.426600 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:00.432532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:00.433021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:00.433467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:00.434154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:00.434608 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:00.435037 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:00.565161 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:00.574495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d2a277f5-1fbb-4aa6-bcad-6ccd6cd270bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.152283 Aug 18 20:56:00.575336 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 165/322] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:00 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:00.607247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:00.608969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:00.614670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:00.615161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:00.615622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:00.616324 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:00.616782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:00.617207 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:00.649123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:00.649604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:00.650038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:00.650581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:00.696892 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:00.704700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c0e528a7-746c-43c0-a1d0-abf7779e81c1 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.101579 Aug 18 20:56:00.705257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 158/323] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:00 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:01.393350 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:01.394138 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:01.404488 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.405325 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.406063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.407239 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.408091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.408842 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.566086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:01.574089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:01.575623 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:01.576696 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-da8bda50-6803-4880-821b-944fb43c26d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.188220 Aug 18 20:56:01.577244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 166/324] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:01 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:56:01.599287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:01.600273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:01.606748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.607231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.608198 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.608757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.609320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.609630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.726324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:01.726966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:01.733394 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.733894 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.734301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.734990 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.735457 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.735876 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.744221 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:01.752191 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1aeac164-284f-4a7a-b9cd-043e0e7993c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1501 microversion: 2.1 time: 0.157738 Aug 18 20:56:01.752745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 159/325] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:01 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:01.768212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.771840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.772304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.772777 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:01.774742 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1338512a-523b-42bd-a2d3-2e707394a0c0"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:01.780316 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:01.784550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.785038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.785676 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.787054 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.787539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.787968 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.813472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] HTTP exception thrown: Cannot 'attach_volume' instance df6d725b-6c0e-43f3-b240-99f9a739d63f while it is in vm_state rescued Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Request method failure captured: Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: POST /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f/os-volume_attachments HTTP/1.1 Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 74 Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbG5VsOMS_bHA47YGbs9T8iiAhJ7sT72ojAQ8H0kbJOh8ksbD2jEeQpei16A7FR5Po6xX7fVc4ubiig8qP_kQqbckUucJP-7z1dPwV6WWN-o7_JNk8ZkZiDzqX5ys25l5-Zg0LnhCjUh41AMK1mgLVpRad16ov41Q36Msw82ah5tX4 Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 20:56:01.815096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_119af0f155d0477cbc4a15a054070278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/119af0f155d0477cbc4a15a054070278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 86c2b496a2c04a0094bf30111bf25669 Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {"volumeAttachment": {"volumeId": "1338512a-523b-42bd-a2d3-2e707394a0c0"}} Aug 18 20:56:01.816775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Cannot 'attach_volume' instance df6d725b-6c0e-43f3-b240-99f9a739d63f while it is in vm_state rescued Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'server_id': 'df6d725b-6c0e-43f3-b240-99f9a739d63f', 'body': {'volumeAttachment': {'volumeId': '1338512a-523b-42bd-a2d3-2e707394a0c0'}}} Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance df6d725b-6c0e-43f3-b240-99f9a739d63f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:56:01.820136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance df6d725b-6c0e-43f3-b240-99f9a739d63f while it is in vm_state rescued Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:56:01.822089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:56:01.823784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:56:01.823784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:56:01.823784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance df6d725b-6c0e-43f3-b240-99f9a739d63f while it is in vm_state rescued Aug 18 20:56:01.823784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:56:01.823784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Returning 409 to user: Cannot 'attach_volume' instance df6d725b-6c0e-43f3-b240-99f9a739d63f while it is in vm_state rescued {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:56:01.823784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-293013a5-80bc-470a-afb8-6fa5c32b8b2e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047068 Aug 18 20:56:01.823784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 160/326] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 20:56:01 2022] POST /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 18 20:56:01.826634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:01.831675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:01.832698 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:01.834628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d5b40c61-b652-4e40-b208-7ad769d8c500 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.112148 Aug 18 20:56:01.835382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 167/327] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:01 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:01.846585 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.847205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.847811 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:01.849153 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:01.849648 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:01.850081 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.110284 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b741d398-2484-4aa6-8bb2-01e200b2209d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f/action" status: 202 len: 0 microversion: 2.1 time: 0.287891 Aug 18 20:56:02.114795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 161/328] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 20:56:01 2022] POST /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 20:56:02.119552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:02.120168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:02.126103 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:02.126586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:02.127022 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.127747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:02.128204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:02.128632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.314483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:02.322343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b502fae3-debc-44fd-a11f-310ed6d556da tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.206588 Aug 18 20:56:02.322913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 168/329] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:02 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:02.600483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:02.601182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:02.607846 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:02.608329 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:02.608766 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.609460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:02.609910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:02.610340 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.752653 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:02.763682 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:02.765384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:02.766721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-72c31432-2f6a-4ee3-a30b-e5ad839b488c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.170469 Aug 18 20:56:02.767467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 162/330] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:02 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:56:02.856330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:02.856939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:02.863441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:02.866272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:02.866272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.866272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:02.866272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:02.866726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.900532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:02.901001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:02.901435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:02.901891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:02.945238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:02.953404 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-feef660d-912f-4fef-b932-5ceb7b97e57c tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.101013 Aug 18 20:56:02.954248 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 169/331] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:02 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:03.399719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:03.399719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:03.399719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:03.399719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:03.400102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:03.400102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:03.400102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:03.400102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:03.400444 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:03.499407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:03.508199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-346e6803-79e7-492f-90b3-7b9b656108b4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.167123 Aug 18 20:56:03.508775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 163/332] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:03 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:03.790556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:03.791153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:03.797060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:03.797534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:03.797962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:03.798750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:03.799201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:03.799648 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:03.929580 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:03.937647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:03.939141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:03.940267 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2a1a505e-b70e-4240-8d15-2a889c8cb34c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.153649 Aug 18 20:56:03.940820 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 170/333] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:03 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:56:03.982538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:03.983145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:03.990781 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:03.991257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:03.991709 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:03.992387 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:03.992835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:03.993248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:04.024034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:04.024507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:04.024935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:04.025368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:04.069429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:04.077138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-87d24bf6-12e4-474d-9b50-8db822297a91 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.098577 Aug 18 20:56:04.077744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 164/334] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:03 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:04.534468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:04.535115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:04.542236 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:04.542721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:04.543158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:04.543895 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:04.545970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:04.546431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:04.680200 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:04.688509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d78755e7-00fd-409a-8859-ec2e8c02d0ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.159621 Aug 18 20:56:04.689086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 171/335] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:04 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:04.963382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:04.964018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:04.970133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:04.970610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:04.971053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:04.971767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:04.972222 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:04.972649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:05.098207 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:05.098835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:05.100409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:05.100816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=94 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:05.105641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:05.106131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:05.106569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:05.107265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:05.107936 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:05.108364 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:05.109020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:05.114472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:05.114472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2259dd07-cfe0-485f-bbdf-0c2ba0ca69b3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.153004 Aug 18 20:56:05.114472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 165/336] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:04 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:56:05.142029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:05.142379 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:05.142819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:05.143270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:05.146430 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:05.184174 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:05.192060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-60931d5d-90bd-40c1-80af-74b5a4a3de56 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.097889 Aug 18 20:56:05.193194 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 172/337] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:05 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:56:05.708973 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:05.709509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:05.716459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:05.716946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:05.717381 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:05.718071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:05.718546 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:05.718965 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:05.847021 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:05.855394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0367ce76-454d-48fd-9958-79be4e0ec12c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.150406 Aug 18 20:56:05.855860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 166/338] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:05 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:06.134175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:06.134764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:06.141933 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:06.142490 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:06.142936 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:06.143665 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:06.144125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:06.144560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:06.214130 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:06.214734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:06.221172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:06.221645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:06.222073 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:06.222755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:06.223201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:06.224337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:06.257126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:06.257602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:06.258027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:06.258463 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:06.275711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:06.284004 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:06.285490 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:06.286672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2eb070a2-3315-428f-bcb6-c2f1ba0e0bab tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.156444 Aug 18 20:56:06.287222 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 173/339] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:06 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:56:06.303212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:06.311160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-51d39869-f850-453e-b249-ccce81b162f5 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.100734 Aug 18 20:56:06.311767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 167/340] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:06 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:56:06.876337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:06.876948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:06.883744 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:06.884235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:06.884674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:06.885384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:06.885838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:06.886316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:07.019699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:07.027556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-028eaafa-129c-44af-9325-bdd6446463ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.155050 Aug 18 20:56:07.028111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 174/341] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:06 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:07.309251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:07.309895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:07.316429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:07.316909 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:07.317342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:07.318028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:07.318621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:07.319049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:07.332148 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:07.332742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:07.339702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:07.340193 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:07.340665 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:07.341408 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:07.341861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:07.342288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:07.374993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:07.375506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:07.375948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:07.376395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:07.417829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:07.425637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-89102d23-bac3-4a70-9816-7ffa7a0a7b75 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.097288 Aug 18 20:56:07.426210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 175/342] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:07 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:56:07.453104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:07.461657 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:07.463135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:07.464301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9f9ee053-869e-4e89-aaba-52a7da38a2d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.159034 Aug 18 20:56:07.464839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 168/343] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:07 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:56:08.048684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:08.049302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:08.055326 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:08.055854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:08.056297 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:08.057030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:08.057494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:08.057921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:08.185917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:08.194266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-10bb497b-c24f-4b17-a2ed-69c38834231e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.149444 Aug 18 20:56:08.194829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 176/344] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:08 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:08.446800 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:08.447400 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:08.453832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:08.454301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:08.455935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:08.455935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:08.456126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:08.456458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:08.493472 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:08.494540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:08.496770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:08.497550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:08.498256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:08.499033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:08.503838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:08.504629 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:08.505346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:08.506476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:08.507441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:08.508116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:08.546321 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:08.554943 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8d4a12c5-cfa8-41f7-8d8d-be8f41cc250b tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.112592 Aug 18 20:56:08.555551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 169/345] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:08 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:56:08.649161 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:08.657477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:08.661304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:08.661304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c521ac9a-345f-4c1c-bffe-c2bf6900c2cf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1407 microversion: 2.20 time: 0.173956 Aug 18 20:56:08.661304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 177/346] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:08 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:56:09.214880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:09.215551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:09.221553 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.222039 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.222476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.223173 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.223652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.224079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.363337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:09.372939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f81ea69b-c769-477b-9b63-066ad218400e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.162671 Aug 18 20:56:09.380139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 170/347] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:09 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:09.575466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:09.576095 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:09.582266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.582757 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.583540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.583892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.584369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.584799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.618326 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.619068 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.619529 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.619994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lazy-loading 'fault' on Instance uuid 4b40b497-83cf-4d49-8055-d89433cef13f {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:56:09.682807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:09.686908 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:09.688950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24bcdddbaba14098b3c12bbc679f988d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a616fee258c14f1289fb10ecc7354067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:09.690209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.691312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.691869 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.692642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.693225 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.693225 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.702096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cfe6fe09-cb7b-4d16-93fe-6683d2e46d7a tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 200 len: 1305 microversion: 2.1 time: 0.130514 Aug 18 20:56:09.702697 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 178/348] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:09 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 1305 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:09.851800 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:09.863920 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:09.865765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:09.867619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-14c55020-6fbc-4139-8f0b-54f7a2d6f9e5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1600 microversion: 2.20 time: 0.189313 Aug 18 20:56:09.868509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 171/349] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:56:09 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1600 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:56:09.890486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:09.890987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:09.898186 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.898682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.899117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:09.900063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:09.900520 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:09.900950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:10.005020 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3f246354-0787-43d6-a7b4-f0b448d46473 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.118348 Aug 18 20:56:10.005832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 179/350] 10.222.0.62 () {60 vars in 1316 bytes} [Thu Aug 18 20:56:09 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:56:10.393868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:10.394480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:10.400855 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:10.401342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:10.401783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:10.402480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:10.402935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:10.403394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:10.586442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:10.594222 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e214a354-60a3-4846-b1e4-15ff1575ca90 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.204155 Aug 18 20:56:10.594712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 172/351] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:10 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:10.723389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:10.724071 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] [instance: 4b40b497-83cf-4d49-8055-d89433cef13f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:10.730991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:10.731518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:10.731955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:10.732846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:10.733300 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:10.733722 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:10.748084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] HTTP exception thrown: Instance 4b40b497-83cf-4d49-8055-d89433cef13f could not be found. Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Request method failure captured: Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f HTTP/1.1 Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qcvd_q-PEII2xCzJrfrYorpgDqMZUeLIJ5nXh9OXR-N7E4R8zxZiosWrbr1K1hd9pTx0aTi-N3QuhAD5PA-Ng62LJ-fAi2hqSMws2AgPBymyRpzsCtr-fkC2FH1qbxvPW7atMBU70e_QlFCH33AQ1Y9GZvWR9mw3TlBRxzsyHYQjrw Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: a616fee258c14f1289fb10ecc7354067 Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesNegativeTest-511396360 Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:56:10.749869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_a616fee258c14f1289fb10ecc7354067"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a616fee258c14f1289fb10ecc7354067"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/a616fee258c14f1289fb10ecc7354067"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/a616fee258c14f1289fb10ecc7354067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesNegativeTest-511396360 Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: a616fee258c14f1289fb10ecc7354067 Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesNegativeTest-511396360 Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesNegativeTest-511396360-project Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 24bcdddbaba14098b3c12bbc679f988d Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesNegativeTest-511396360-project Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 4b40b497-83cf-4d49-8055-d89433cef13f could not be found. Aug 18 20:56:10.752872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '4b40b497-83cf-4d49-8055-d89433cef13f'} Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b40b497-83cf-4d49-8055-d89433cef13f could not be found. Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:56:10.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b40b497-83cf-4d49-8055-d89433cef13f could not be found. Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b40b497-83cf-4d49-8055-d89433cef13f could not be found. Aug 18 20:56:10.755015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:56:10.756217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] Returning 404 to user: Instance 4b40b497-83cf-4d49-8055-d89433cef13f could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:56:10.756217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a3e2bc26-530e-40a2-9edf-fcdfcc779fd3 tempest-VolumesNegativeTest-511396360 tempest-VolumesNegativeTest-511396360-project] 10.222.0.62 "GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f" status: 404 len: 111 microversion: 2.1 time: 0.031852 Aug 18 20:56:10.756217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 180/352] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:10 2022] GET /compute/v2.1/servers/4b40b497-83cf-4d49-8055-d89433cef13f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:56:11.099069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-95c2b809-11fa-4a4f-bd56-de3859f028c4 req-138ed68d-b911-42d7-ba6c-fec020c2e0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36c76af8-35e8-4dbe-885d-cb5510af2411", "tag": "2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:11.109828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-95c2b809-11fa-4a4f-bd56-de3859f028c4 req-138ed68d-b911-42d7-ba6c-fec020c2e0b8 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:11.110292 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-95c2b809-11fa-4a4f-bd56-de3859f028c4 req-138ed68d-b911-42d7-ba6c-fec020c2e0b8 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:11.110719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-95c2b809-11fa-4a4f-bd56-de3859f028c4 req-138ed68d-b911-42d7-ba6c-fec020c2e0b8 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:11.122601 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-95c2b809-11fa-4a4f-bd56-de3859f028c4 req-138ed68d-b911-42d7-ba6c-fec020c2e0b8 service nova] Creating event network-changed:2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca for instance 36c76af8-35e8-4dbe-885d-cb5510af2411 on hv-cinder-85265 Aug 18 20:56:11.127778 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-95c2b809-11fa-4a4f-bd56-de3859f028c4 req-138ed68d-b911-42d7-ba6c-fec020c2e0b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Aug 18 20:56:11.128881 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 173/353] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:56:11.614991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:11.616391 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:11.622430 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:11.623011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:11.623554 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:11.624780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:11.629137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:11.629137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:11.771860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:11.784422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dd72f95f-b3c6-471b-9bb2-f5f1ae6d9a7f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.169764 Aug 18 20:56:11.784422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 181/354] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:11 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:12.804028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:12.804825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:12.812036 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:12.814683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:12.814683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:12.814683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:12.814683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:12.815332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:12.954168 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:12.962563 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a6e9eab9-0efb-43db-b332-895c02d5eaee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.164123 Aug 18 20:56:12.963167 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 174/355] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:12 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:13.983677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:13.984404 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:13.990663 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:13.991731 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:13.992213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:13.992934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:13.993373 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:13.993799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:14.128426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:14.136771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7e4f7dcf-93b0-46be-9be9-88e7db3fee07 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.157087 Aug 18 20:56:14.141672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 182/356] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:13 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:15.159982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:15.160713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:15.167495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:15.167987 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:15.168425 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:15.169136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:15.169590 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:15.170017 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:15.308108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:15.316246 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bd948b22-c464-4d10-862a-87eaf8b35243 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.162000 Aug 18 20:56:15.316818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 175/357] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:15 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:16.337544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:16.338154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:16.344250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:16.344736 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:16.345168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:16.345897 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:16.346347 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:16.346774 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:16.476889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:16.485051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dd7c7c2e-ca8a-44f3-aca2-295106f09d20 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.151731 Aug 18 20:56:16.485601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 183/358] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:16 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:17.505847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:17.506455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:17.513158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:17.513645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:17.514081 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:17.514907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:17.515238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:17.515732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:17.661799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:17.669631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7dfdefa9-211e-4750-9e63-4128181fa6b0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.167531 Aug 18 20:56:17.670231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 176/359] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:17 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:18.690801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:18.691488 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:18.698358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:18.698856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:18.699682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:18.700416 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:18.700874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:18.701465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:18.936340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:18.945819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-833b340a-e027-40c8-bc17-393ba4b9b2db tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1509 microversion: 2.1 time: 0.258813 Aug 18 20:56:18.946395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 184/360] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:18 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:19.968604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:19.969216 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:19.975815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:19.976839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:19.977270 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:19.977965 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:19.978409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:19.978831 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:20.139685 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:20.148543 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-76e1f5c9-c628-4437-a52c-9e89fc699793 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1515 microversion: 2.1 time: 0.185208 Aug 18 20:56:20.149115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 177/361] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:19 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:23.238079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b3869403-b508-467f-ae4f-ce1035f6e5f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'create', calling method: .version_select at 0x7f8b5a5405e0>, body: {"keypair": {"name": "tempest-keypair-1432252144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOE7/AcGCEx171MKUMk8KFY6kYRUhZSzJrcUAVsA0F5x9hFHsP2taUKV+28RY6/5RZL5oaR7RGz/TqoF5/iv6yi0AJm+f4S+VKfAA79PI7sli8NRzUeBq3XfRVY+bl4Dww=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:23.258098 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-b3869403-b508-467f-ae4f-ce1035f6e5f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for project 119af0f155d0477cbc4a15a054070278. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:56:23.262487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-b3869403-b508-467f-ae4f-ce1035f6e5f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for user 86c2b496a2c04a0094bf30111bf25669 and project 119af0f155d0477cbc4a15a054070278. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:56:23.360532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b3869403-b508-467f-ae4f-ce1035f6e5f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127510 Aug 18 20:56:23.361210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 185/362] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 20:56:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:56:26.189021 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1073159921", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c154e09-d159-4559-8961-a918c8fdec5a"}], "security_groups": [{"name": "tempest-securitygroup--1589587420"}], "key_name": "tempest-keypair-1432252144", "user_data": "}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:26.198847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=68 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:26.303106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] validate_networks() for [('4c154e09-d159-4559-8961-a918c8fdec5a', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:56:26.941881 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:56:26.942302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:56:26.942769 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:56:26.943170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:56:26.945809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:56:26.952917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:26.953398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:26.953824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:26.954625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:26.955079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:26.955529 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:26.972956 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for project 119af0f155d0477cbc4a15a054070278. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:56:26.978141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Getting quotas for user 86c2b496a2c04a0094bf30111bf25669 and project 119af0f155d0477cbc4a15a054070278. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:56:26.990017 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:56:26.992372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:56:27.171407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-98e28d18-8a63-44fb-9ecf-12ac71c593c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.986418 Aug 18 20:56:27.173174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 178/363] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:56:26 2022] POST /compute/v2.1/servers => generated 409 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:56:27.184362 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b61d842a-ccf4-4134-b191-03fd96753e74 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:27.185073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b61d842a-ccf4-4134-b191-03fd96753e74 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:27.280082 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b61d842a-ccf4-4134-b191-03fd96753e74 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:27.288121 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b61d842a-ccf4-4134-b191-03fd96753e74 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1246 microversion: 2.1 time: 0.108301 Aug 18 20:56:27.288725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 186/364] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:27 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:28.310671 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:28.311320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:28.317439 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:28.317932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:28.318372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:28.319071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:28.319565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:28.319991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:28.387304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:28.395237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-65fef2af-6638-4bd5-8228-502df446875d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1250 microversion: 2.1 time: 0.089190 Aug 18 20:56:28.396062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 179/365] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:28 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:29.420541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:29.421188 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:29.423351 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=72 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:29.430267 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:29.430764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:29.431205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:29.431939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:29.432392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:29.432814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:29.550852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:29.564105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0a713d4e-d1bb-4367-99b9-f93c2f6ba569 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1306 microversion: 2.1 time: 0.150806 Aug 18 20:56:29.579890 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 187/366] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:29 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1306 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:30.587987 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:30.588610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:30.598334 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:30.598334 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:30.602161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:30.602920 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:30.603696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:30.604147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:30.635576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:30.814604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:30.825907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8dff1341-a542-4d47-a8a5-818d74bc0697 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.242192 Aug 18 20:56:30.839679 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 180/367] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:30 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:31.848710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:31.849318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:31.855274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:31.855791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:31.856229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:31.856918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:31.857369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:31.857791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:31.988140 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:31.996006 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-28bd25ae-21d7-44a9-9af7-2939a92686c5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.151173 Aug 18 20:56:31.996569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 188/368] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:31 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:33.017365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:33.018024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:33.025785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:33.026265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:33.026701 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:33.027427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:33.027883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:33.028311 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:33.161221 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:33.169863 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-31cf7eaa-18fc-4090-8879-8b566a638c67 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.156572 Aug 18 20:56:33.170353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 181/369] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:33 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:34.191119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:34.191834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:34.199668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:34.200578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:34.201265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:34.202074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:34.202525 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:34.203069 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:34.341255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:34.349592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a5a1dbe5-1712-4024-86d4-b38751d3456c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.162929 Aug 18 20:56:34.350355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 189/370] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:34 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:35.370456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:35.371099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:35.377690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:35.378183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:35.378615 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:35.379323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:35.379805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:35.380223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:35.381664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-fe47f866-c57b-4d89-8a12-77545a46566a req-6118742e-3404-4a43-b1dc-358f60d69588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0c74d7-66e9-4538-85d5-b0841ff4bd25", "tag": "94bc5780-2e28-429c-9fa9-60743d75ef5f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:35.388065 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:35.393071 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-fe47f866-c57b-4d89-8a12-77545a46566a req-6118742e-3404-4a43-b1dc-358f60d69588 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:35.393832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-fe47f866-c57b-4d89-8a12-77545a46566a req-6118742e-3404-4a43-b1dc-358f60d69588 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:35.394636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-fe47f866-c57b-4d89-8a12-77545a46566a req-6118742e-3404-4a43-b1dc-358f60d69588 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:35.407826 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-fe47f866-c57b-4d89-8a12-77545a46566a req-6118742e-3404-4a43-b1dc-358f60d69588 service nova] Creating event network-changed:94bc5780-2e28-429c-9fa9-60743d75ef5f for instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 on hv-cinder-85265 Aug 18 20:56:35.413519 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-fe47f866-c57b-4d89-8a12-77545a46566a req-6118742e-3404-4a43-b1dc-358f60d69588 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036040 Aug 18 20:56:35.415094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 190/371] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:56:35.524128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:35.532672 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-37838437-dd3a-4d8d-9453-6f690ed87083 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.166126 Aug 18 20:56:35.533234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 182/372] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:35 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:36.553654 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:36.554866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:36.561587 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:36.562078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:36.562517 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:36.563356 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:36.563703 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:36.564134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:36.697607 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:36.705292 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cb8214b8-9cd5-4b51-84de-40d892dd37bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.155874 Aug 18 20:56:36.705832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 191/373] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:36 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:37.726102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:37.726683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:37.729086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:37.729799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:37.734784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:37.735206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:37.735674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:37.736395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:37.736849 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:37.737475 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:37.876073 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:37.884448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a3d823d2-83c2-4e13-be70-413114978553 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.162279 Aug 18 20:56:37.885024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 183/374] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:37 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:38.905689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:38.906297 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:38.908181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=6 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:38.913084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:38.913626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:38.914066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:38.914764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:38.915221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:38.915678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:39.051606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:39.060290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6b2e8823-c683-48da-8082-1ac682e35a26 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.158523 Aug 18 20:56:39.061079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 192/375] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:38 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:40.082347 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:40.082982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:40.090277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:40.090765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:40.091201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:40.091946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:40.092407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:40.092835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:40.242061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:40.250298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5c079e92-22af-4e67-ac5e-06c9d7daacef tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.172171 Aug 18 20:56:40.250866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 184/376] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:40 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:41.272837 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:41.274007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:41.281537 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:41.282050 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:41.282587 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:41.283206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:41.283698 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:41.284131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:41.430340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:41.438235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c4a37050-a63c-406d-80b7-1bfd640c70f5 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.170553 Aug 18 20:56:41.438799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 193/377] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:41 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:42.459635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:42.460255 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:42.470456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:42.471060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:42.471398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:42.472119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:42.472751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:42.473187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:42.614738 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:42.622417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-373db25b-7d3d-4cdc-ae65-2ad4f13fd2b9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.166715 Aug 18 20:56:42.622987 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 185/378] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:42 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:43.644114 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:43.644725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:43.657859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:43.658355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:43.658791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:43.660081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:43.660081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:43.660494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:43.813869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:43.822759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9597fcb1-ecd4-4dc0-bb38-98a90cb95ef8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.182437 Aug 18 20:56:43.823342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 194/379] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:43 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:44.846819 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:44.848484 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:44.857976 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:44.858699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:44.859304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:44.860388 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:44.861013 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:44.861835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:45.127296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:45.136861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-055815aa-1c76-4fce-8360-e441d9af1492 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.296894 Aug 18 20:56:45.137934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 186/380] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:44 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:45.385745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-dbdedd3e-ca70-4729-8a5b-e56287e0315c req-4d42baf7-b752-4ae0-ba3c-21cdf62764c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0c74d7-66e9-4538-85d5-b0841ff4bd25", "name": "network-vif-plugged", "status": "completed", "tag": "94bc5780-2e28-429c-9fa9-60743d75ef5f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:45.395848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-dbdedd3e-ca70-4729-8a5b-e56287e0315c req-4d42baf7-b752-4ae0-ba3c-21cdf62764c9 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:45.396333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-dbdedd3e-ca70-4729-8a5b-e56287e0315c req-4d42baf7-b752-4ae0-ba3c-21cdf62764c9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:45.397034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-dbdedd3e-ca70-4729-8a5b-e56287e0315c req-4d42baf7-b752-4ae0-ba3c-21cdf62764c9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:45.411229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-dbdedd3e-ca70-4729-8a5b-e56287e0315c req-4d42baf7-b752-4ae0-ba3c-21cdf62764c9 service nova] Creating event network-vif-plugged:94bc5780-2e28-429c-9fa9-60743d75ef5f for instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 on hv-cinder-85265 Aug 18 20:56:45.416876 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-dbdedd3e-ca70-4729-8a5b-e56287e0315c req-4d42baf7-b752-4ae0-ba3c-21cdf62764c9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035325 Aug 18 20:56:45.418040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 195/381] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:56:46.173654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:46.175196 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:46.184533 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:46.185134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:46.185651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:46.186418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:46.186934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:46.187768 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:46.323302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:46.331016 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-87a5e9c5-8a42-4c74-ab43-bd01ae2fc47a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.168630 Aug 18 20:56:46.331603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 187/382] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:46 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:47.354612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:47.356106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:47.364759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:47.367471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:47.367471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:47.367471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:47.367471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:47.367880 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:47.522619 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:47.542073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0b65df53-5c08-46c0-b8a9-89dcd82072ff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1372 microversion: 2.1 time: 0.193912 Aug 18 20:56:47.556595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 196/383] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:47 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:48.563295 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:48.563960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:48.571991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:48.578111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:48.578111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:48.578111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:48.578111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:48.579124 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:48.753042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:56:48.766762 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5a6bff34-dcb6-4a27-9185-7eadd3723c2f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1566 microversion: 2.1 time: 0.204040 Aug 18 20:56:48.766762 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 188/384] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:56:48 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1566 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:56:48.790807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:56:48.791315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:56:48.797628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:48.798115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:48.798550 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:48.799253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:48.799763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:48.800190 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:48.886096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-48b77bf1-c6ac-45e6-b646-136ea068b276 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099796 Aug 18 20:56:48.886693 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 197/385] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 20:56:48 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:56:49.349245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 20:56:49.350163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Thu Aug 18 20:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 20:56:50.384297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-20ca4246-9e8d-492f-a1df-539490a5a167 req-fcd84967-5c08-498e-82a0-ba86a0350993 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0c74d7-66e9-4538-85d5-b0841ff4bd25", "tag": "94bc5780-2e28-429c-9fa9-60743d75ef5f"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:50.399784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-20ca4246-9e8d-492f-a1df-539490a5a167 req-fcd84967-5c08-498e-82a0-ba86a0350993 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:56:50.399784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-20ca4246-9e8d-492f-a1df-539490a5a167 req-fcd84967-5c08-498e-82a0-ba86a0350993 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:56:50.399784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-20ca4246-9e8d-492f-a1df-539490a5a167 req-fcd84967-5c08-498e-82a0-ba86a0350993 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:56:50.416654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-20ca4246-9e8d-492f-a1df-539490a5a167 req-fcd84967-5c08-498e-82a0-ba86a0350993 service nova] Creating event network-changed:94bc5780-2e28-429c-9fa9-60743d75ef5f for instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 on hv-cinder-85265 Aug 18 20:56:50.423949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-20ca4246-9e8d-492f-a1df-539490a5a167 req-fcd84967-5c08-498e-82a0-ba86a0350993 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044281 Aug 18 20:56:50.428519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 189/386] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:56:56.741917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-50d21045-1446-46c6-a27e-1c8eab9bf9c2 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Action: 'create', calling method: .version_select at 0x7f8b5adace50>, body: {"keypair": {"name": "tempest-TestShelveInstance-85954469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEHI5z6cy/oJCYG1zATh9ntdDk6D7GOhjjH8Ms/8d7ZWjAVERoQ9Zde/MERH/D3uPVWGEM0z7MRJ0TbOUlh2rH6Koys/UO6WYMti1PuCdE9Tz8UXzDEZSGvcb9/3MLchg=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:56:56.759233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-50d21045-1446-46c6-a27e-1c8eab9bf9c2 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Getting quotas for project 209bb8eb567b434088d163ae1eafe79c. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:56:56.763434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-50d21045-1446-46c6-a27e-1c8eab9bf9c2 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Getting quotas for user 72e153ab64294e518c3ce4ac03077ab8 and project 209bb8eb567b434088d163ae1eafe79c. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:56:56.893426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-50d21045-1446-46c6-a27e-1c8eab9bf9c2 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.359224 Aug 18 20:56:56.894671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 198/387] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 20:56:56 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:11.359913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:11.361274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:11.374532 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:11.376042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=52 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:11.378290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:11.378983 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:11.379723 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:11.380727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:11.381351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:11.382090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:11.430798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ffeb7d24-d676-4444-ad31-703762c12e1a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/ips" status: 200 len: 149 microversion: 2.1 time: 0.093763 Aug 18 20:57:11.432204 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 190/388] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 20:57:11 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:14.591347 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:14.594498 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:14.598045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=56 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:14.599751 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=4 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:14.600409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:14.605268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:14.605748 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:14.606280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:14.606902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:14.607339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:14.607862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:15.636479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2b65668e-556b-4d18-bbc0-fdc7a24da3fa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051509 Aug 18 20:57:15.638208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 199/389] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 20:57:14 2022] POST /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:24.348276 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-527fe809-dc51-4ed2-b512-378e44b25b70 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: .version_select at 0x7f8b5a6ce3a0>, body: {"keypair": {"name": "tempest-keypair-240110198", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+oSF/FYUogpUQKUWoFVFLgiGTbIaRgKqjCoghxuQYy56ABDc8ao8HVhKnll1adBzUBsX+/HzdH99KiJeETeiZxmMsCVPXIASF6h4CZVxTlx/r3khk+Nb3qH7nRGw5h/w=="}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:24.371280 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-527fe809-dc51-4ed2-b512-378e44b25b70 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:57:24.381576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-527fe809-dc51-4ed2-b512-378e44b25b70 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:57:24.515813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-527fe809-dc51-4ed2-b512-378e44b25b70 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171649 Aug 18 20:57:24.516621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 191/390] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 20:57:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:26.671077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b72a1c92-cf49-4db7-893b-7b64a1ccbde3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Action: 'create', calling method: .version_select at 0x7f8b5a540e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1618294974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi/FWi2c2Mg3OU0mzLoM65FWuX8PYD5GWnxtArwLtDr7YZlYparBD3blWjQkuUR/PrNGYl7BphBLcI3C+3h2q5H5s4+Cc+i5wWOOTU6J1aVBf9cvDzLN2SBU/IxfdlO9w=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:26.677293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:26.678107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:26.690115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-b72a1c92-cf49-4db7-893b-7b64a1ccbde3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Getting quotas for project 3ed3d374c7a145918d9ad3b770cb562b. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:57:26.695154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-b72a1c92-cf49-4db7-893b-7b64a1ccbde3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Getting quotas for user d87dd0b10a4a4db39935df509bc8eb0b and project 3ed3d374c7a145918d9ad3b770cb562b. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:57:26.810910 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b72a1c92-cf49-4db7-893b-7b64a1ccbde3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.143995 Aug 18 20:57:26.811670 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 200/391] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 20:57:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:26.865306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-519602168", "imageRef": "31bf94c9-4b1d-448b-baba-63b0df63f30f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1618294974", "networks": [{"uuid": "b9677b6c-a874-4633-8380-49c5ea803a63"}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:26.924379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] validate_networks() for [('b9677b6c-a874-4633-8380-49c5ea803a63', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:57:27.720993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:57:27.721495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:57:27.722031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:57:27.722508 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:57:27.723045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:57:27.732582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:27.733154 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:27.734584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:27.734584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:27.734808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:27.735158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:27.754618 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Getting quotas for project 3ed3d374c7a145918d9ad3b770cb562b. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:57:27.758633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Getting quotas for user d87dd0b10a4a4db39935df509bc8eb0b and project 3ed3d374c7a145918d9ad3b770cb562b. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:57:27.771916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:57:27.777673 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='31bf94c9-4b1d-448b-baba-63b0df63f30f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:57:27.939269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cd96156a-b8f9-45fa-947d-968cfd0c241c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077703 Aug 18 20:57:27.940686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 192/392] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:57:27.956329 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-939f84e7-1f5a-465f-bbfc-32820633e330 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:27.957233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-939f84e7-1f5a-465f-bbfc-32820633e330 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:28.043658 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1416823851", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-85954469", "security_groups": [{"name": "tempest-secgroup-smoke-2056111651"}], "networks": [{"uuid": "cac92d6e-2741-48f5-962f-23e0de0c24a2"}], "block_device_mapping_v2": [{"uuid": "9298ec7c-5181-4462-bf5b-c79a2cec1b72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:28.044955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-939f84e7-1f5a-465f-bbfc-32820633e330 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:28.052587 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-939f84e7-1f5a-465f-bbfc-32820633e330 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1258 microversion: 2.1 time: 0.104595 Aug 18 20:57:28.053226 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 201/393] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:27 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1258 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:28.176634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] validate_networks() for [('cac92d6e-2741-48f5-962f-23e0de0c24a2', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:57:28.216564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-598509256", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c5039fe-c5ac-448f-a973-5b4f5015467c"}], "security_groups": [{"name": "tempest-securitygroup--987950992"}], "key_name": "tempest-keypair-240110198", "user_data": "}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:28.331495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.network.neutron [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] validate_networks() for [('1c5039fe-c5ac-448f-a973-5b4f5015467c', None, None, None, None, None)] {{(pid=127936) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 20:57:28.558165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:57:28.558585 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:57:28.559068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:57:28.559554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:57:28.559964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:57:28.568496 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:28.568970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:28.569402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:28.570117 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:28.571145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:28.571596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:28.589970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Getting quotas for project 209bb8eb567b434088d163ae1eafe79c. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:57:28.595274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Getting quotas for user 72e153ab64294e518c3ce4ac03077ab8 and project 209bb8eb567b434088d163ae1eafe79c. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:57:28.654375 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:57:28.656430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9298ec7c-5181-4462-bf5b-c79a2cec1b72',volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:57:28.729527 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 20:57:28.730032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 20:57:28.730615 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 20:57:28.731102 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 20:57:28.731610 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 20:57:28.742677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:28.743271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:28.743836 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:28.744572 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:28.745028 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:28.745458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:28.763116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 20:57:28.767077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 20:57:28.778892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Going to run 1 instances... {{(pid=127936) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 20:57:28.781156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127936) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 20:57:28.989370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-124d67b3-fcf9-47b0-865e-387d6d6e9304 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.776758 Aug 18 20:57:28.990780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 202/394] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:57:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:57:29.001693 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6baa4836-2bc7-44c8-8e67-2515aab26627 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:29.002321 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6baa4836-2bc7-44c8-8e67-2515aab26627 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:29.065847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6baa4836-2bc7-44c8-8e67-2515aab26627 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:29.072915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6baa4836-2bc7-44c8-8e67-2515aab26627 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1240 microversion: 2.1 time: 0.075171 Aug 18 20:57:29.073511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 203/395] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:28 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:29.084041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dddda89b-a4c9-4b68-b814-fc17c5cc3d96 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:29.084041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dddda89b-a4c9-4b68-b814-fc17c5cc3d96 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:29.147246 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dddda89b-a4c9-4b68-b814-fc17c5cc3d96 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:29.153419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dddda89b-a4c9-4b68-b814-fc17c5cc3d96 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1258 microversion: 2.1 time: 0.076892 Aug 18 20:57:29.154159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 204/396] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:29 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:29.298185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-93908f2a-a3e3-4612-a8b2-e410f2086f18 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.260139 Aug 18 20:57:29.299152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 193/397] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 20:57:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 20:57:29.309554 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0f1b0e25-2c9c-4f58-953a-d22916d9bf3e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:29.310160 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0f1b0e25-2c9c-4f58-953a-d22916d9bf3e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:29.419577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0f1b0e25-2c9c-4f58-953a-d22916d9bf3e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:29.426370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0f1b0e25-2c9c-4f58-953a-d22916d9bf3e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1087 microversion: 2.1 time: 0.120694 Aug 18 20:57:29.427243 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 205/398] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:29 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1087 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:30.094194 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:30.094807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:30.101308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:30.102450 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:30.102883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:30.103615 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:30.104059 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:30.104476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:30.174338 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:30.176811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:30.177502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:30.180565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cc448722-ac4f-4f45-81e6-ccc63ce7809a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1244 microversion: 2.1 time: 0.090971 Aug 18 20:57:30.181609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 194/399] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:30 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:30.193652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:30.193652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:30.193652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:30.193652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:30.194066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:30.194066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:30.251638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:30.260054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c4869383-23c6-4be6-a466-912d455e9feb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1254 microversion: 2.1 time: 0.087372 Aug 18 20:57:30.262435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 206/400] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:30 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:30.447314 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-01152a93-0bda-48eb-96b6-b271134338f1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:30.447882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-01152a93-0bda-48eb-96b6-b271134338f1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:30.500622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-01152a93-0bda-48eb-96b6-b271134338f1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:30.507506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-01152a93-0bda-48eb-96b6-b271134338f1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1087 microversion: 2.1 time: 0.064653 Aug 18 20:57:30.508580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 195/401] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:30 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:31.201824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:31.202440 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:31.209047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:31.209542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:31.209981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:31.210695 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:31.211742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:31.212229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:31.287539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:31.288163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:31.295346 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:31.295870 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:31.296300 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:31.297013 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:31.297461 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:31.297884 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:31.388536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:31.407111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f206645f-ef5c-40da-a6b0-82ec7fec6dad tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1328 microversion: 2.1 time: 0.127493 Aug 18 20:57:31.407729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 196/402] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:31 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:31.518475 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:31.526882 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3fc6324f-eab8-4f1a-9d43-095b49cba09c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1292 microversion: 2.1 time: 0.328895 Aug 18 20:57:31.527782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 207/403] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:31 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1292 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:31.544126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:31.544703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:31.550921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:31.551412 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:31.551852 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:31.552618 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:31.553072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:31.553491 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:31.617321 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:31.625034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3683d052-b7eb-46ba-9d75-91e8914b08d6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1185 microversion: 2.1 time: 0.095453 Aug 18 20:57:31.627499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 197/404] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:31 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:32.446321 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:32.447777 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:32.466798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:32.467622 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:32.468254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:32.469185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:32.470208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:32.476093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:32.548990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:32.550257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:32.571317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:32.573553 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:32.574001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:32.574733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:32.575192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:32.575659 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:32.681364 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:32.702144 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-62263d57-8b0e-4619-92d6-e849b1fa3215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1298 microversion: 2.1 time: 0.145536 Aug 18 20:57:32.715518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 198/405] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:32 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1298 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:32.721699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:32.721699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:32.736931 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:32.741588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:32.745971 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:32.751015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:32.752743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:32.756357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:32.969354 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:32.979669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:32.984745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8cf36807-4945-487b-bf8b-eb89d9715764 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1203 microversion: 2.1 time: 0.276070 Aug 18 20:57:32.984996 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 199/406] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:32 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1203 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:32.990132 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a2e75328-c562-48e3-9abf-a5ff780666f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.555757 Aug 18 20:57:32.993306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 208/407] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:32 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:33.733951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:33.733951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:33.740077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:33.740642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:33.741079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:33.741992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:33.742767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:33.743558 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:33.901049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:33.908751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ac5d37e8-1d84-4e8a-9155-ffabc04a3fd3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.183480 Aug 18 20:57:33.909307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 200/408] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:33 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:34.009998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:34.011768 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:34.022175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:34.023918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:34.024605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:34.026428 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:34.029651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:34.031211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:34.032006 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:34.032667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:34.038227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:34.039547 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:34.040511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:34.041948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:34.042940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:34.043989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:34.213904 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:34.222629 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bdf3d617-42d8-42c6-a691-5b05e4563c3a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.218245 Aug 18 20:57:34.223216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 209/409] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:34 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:34.235101 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:34.242827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bdba17f3-a490-4036-ab7b-0439c18d7d1b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.232002 Aug 18 20:57:34.243411 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 201/410] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:34 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:34.929668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:34.930276 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:34.936467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:34.941540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:34.941540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:34.941540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:34.941540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:34.941956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:35.072221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:35.079798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bfcb38ab-7fa9-4891-9084-d43ff31b89e5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.154119 Aug 18 20:57:35.080358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 210/411] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:34 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:35.311156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:35.311156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:35.311156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:35.311156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:35.312093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:35.312093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:35.312093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:35.312093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:35.312504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:35.312504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:35.312504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:35.312504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:35.312864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:35.312864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:35.312864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:35.312864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:35.397372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:35.405926 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f9c77773-f8e7-4f63-977c-30e14f71275d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.167411 Aug 18 20:57:35.406505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 202/412] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:35 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:35.410322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:35.419268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ac3157a5-ecd1-4377-849b-aba4e217a4bc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.159225 Aug 18 20:57:35.450823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 211/413] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:35 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:36.101118 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:36.101586 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:36.108263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:36.108753 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:36.109205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:36.109890 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:36.110344 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:36.110770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:36.238429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:36.249692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-071a7c0e-d6c0-4fee-8e52-2248cbdddda6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.152536 Aug 18 20:57:36.250263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 203/414] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:36 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:36.429379 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:36.430755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:36.441066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:36.441563 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:36.442007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:36.442190 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:36.442714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:36.442821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:36.443253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:36.443715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:36.450967 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:36.451544 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:36.451928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:36.452635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:36.453087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:36.453516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:36.584370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:36.598600 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1cb44855-a0a0-47e4-b5c8-55810d29880f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.174266 Aug 18 20:57:36.599263 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 212/415] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:36 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:36.600266 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:36.608631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c2fe5b81-7bb0-426a-b4f7-7b2acb1f5d51 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.170186 Aug 18 20:57:36.609223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 204/416] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:36 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:37.270593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:37.275288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:37.278009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:37.278574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:37.279015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:37.279775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:37.280231 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:37.280658 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:37.426902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:37.435738 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-606a76c9-4879-472d-a3ee-f75f2156d5c2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.168872 Aug 18 20:57:37.436791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 213/417] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:37 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:37.620290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:37.620855 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:37.627467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:37.627959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:37.628394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:37.629089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:37.629218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:37.629540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:37.629701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:37.629993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:37.636088 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:37.636574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:37.637004 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:37.637697 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:37.638148 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:37.638571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:37.772451 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:37.778968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:37.781132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b5e062e0-2e29-481c-938b-b8d1be98a831 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.164663 Aug 18 20:57:37.781883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 205/418] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:37 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:37.799501 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a8070429-6cb5-4af3-a6ef-c6ddc5a75fb8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.173987 Aug 18 20:57:37.812300 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 214/419] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:37 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:38.456531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:38.457172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:38.463807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:38.464293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:38.464727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:38.465428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:38.465883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:38.466308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:38.579633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=4 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:38.620280 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:38.628145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cfd95a9e-ab75-4f53-8070-3c73781d1fbb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.175407 Aug 18 20:57:38.629561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 206/420] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:38 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:38.801297 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:38.801911 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:38.809381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:38.811302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:38.811824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:38.812272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:38.812993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:38.813605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:38.814047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:38.820351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:38.826045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:38.828972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:38.829585 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:38.830129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:38.830948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:38.831543 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:38.832072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:39.005221 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:39.006590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:39.013580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f86afa39-a281-4973-855b-d8565b810310 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.197332 Aug 18 20:57:39.014174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 207/421] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:38 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:39.014902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7b893134-6969-4572-ab57-ac307493515b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.217427 Aug 18 20:57:39.015383 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 215/422] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:38 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:39.650786 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:39.652214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:39.662101 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:39.664060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:39.664060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:39.664060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:39.664481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:39.665101 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:39.799202 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:39.807492 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c2099c46-4c03-484d-9857-e7a87400b56d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.160983 Aug 18 20:57:39.810485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 208/423] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:39 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:40.034988 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:40.035267 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:40.035795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:40.035899 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:40.037653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=18 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:40.041724 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:40.042212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:40.042655 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:40.043035 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:40.043519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:40.043636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:40.043903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:40.044046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:40.044328 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:40.044956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:40.045414 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:40.045848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:40.189057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:40.205427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-281a64a4-1c3c-4c3a-9f6c-40c4ea4a767e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.169695 Aug 18 20:57:40.206410 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 216/424] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:40 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:40.230100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:40.238314 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0a217ea7-3706-49b6-8b90-1e2d2ce1c064 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.207011 Aug 18 20:57:40.239166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 209/425] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:40 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:40.830413 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:40.830945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:40.837552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:40.838021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:40.838458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:40.839162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:40.839652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:40.840081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:41.008634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:41.016360 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1c372b46-edd8-4961-878c-08d79656dcca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.189875 Aug 18 20:57:41.016924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 217/426] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:40 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:41.234369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:41.234940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:41.236739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=18 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:41.242055 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:41.242534 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:41.242965 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:41.243693 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:41.244147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:41.244569 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:41.248917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:41.258093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:41.258811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:41.265240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:41.269859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:41.269859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:41.269859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:41.269859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:41.270226 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:41.398375 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:41.411586 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5a3465eb-0a78-4e23-beb7-ceb773204c85 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.180947 Aug 18 20:57:41.412636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 210/427] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:41 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:41.452011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:41.463605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1ca8ba55-8bd8-4e20-9542-e97ebd27c053 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.209260 Aug 18 20:57:41.477078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 218/428] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:41 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:42.037272 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:42.037903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:42.044337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:42.044808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:42.045234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:42.045915 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:42.046359 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:42.046773 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:42.179132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:42.187756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9a2b8084-0e69-473a-b3dd-8e67d6924231 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.154120 Aug 18 20:57:42.188263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 211/429] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:42 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:42.433418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:42.434018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:42.440410 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:42.440919 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:42.441356 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:42.442052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:42.442505 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:42.442930 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:42.484006 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:42.484824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:42.491283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:42.491801 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:42.492240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:42.492946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:42.493390 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:42.493806 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:42.579646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:42.587288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6a89e319-7a9b-499f-968c-10d9eb4a13ce tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.158278 Aug 18 20:57:42.587882 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 219/430] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:42 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:42.627321 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:42.636247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-786baab7-a0e7-40d6-9174-141864c8c47f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.155868 Aug 18 20:57:42.636829 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 212/431] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:42 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:43.208584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:43.209107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:43.215147 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:43.215653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:43.216093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:43.216820 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:43.217275 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:43.217699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:43.360643 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:43.368559 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a7dfc153-613b-4100-a74d-a6bcedc12127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.164099 Aug 18 20:57:43.369395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 220/432] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:43 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:43.608359 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:43.608953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:43.615637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:43.616123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:43.616786 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:43.617949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:43.618610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:43.619041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:43.657879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:43.658947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:43.672775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:43.673698 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:43.674352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:43.675534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:43.676352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:43.676996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:43.763305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:43.771283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5879deba-e8b5-46cf-b86e-01d6230090a2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.167388 Aug 18 20:57:43.771925 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 213/433] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:43 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:43.817356 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:43.825609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0a50c6db-8958-4f1b-9677-0d5e8d4b7792 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.171871 Aug 18 20:57:43.826234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 221/434] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:43 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:44.390713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:44.391331 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:44.397375 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:44.397940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:44.398379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:44.399336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:44.399810 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:44.400255 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:44.538110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:44.547905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-39d264ae-0331-48e8-bab0-fad6284e20b6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.160863 Aug 18 20:57:44.548776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 214/435] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:44 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:44.792595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:44.793253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:44.800143 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:44.804333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:44.804333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:44.804333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:44.804333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:44.804703 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:44.806592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:44.846143 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:44.846861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:44.854402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:44.855065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:44.855539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:44.856138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:44.856580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:44.856992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:44.935711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:44.944090 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dcd4e63f-2f2c-41b2-b63c-7bbf8652d977 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.154899 Aug 18 20:57:44.944333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 222/436] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:44 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:44.998078 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:45.005740 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1a837416-c930-4ad6-b0ae-40ee6b5b4c29 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.163520 Aug 18 20:57:45.006291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 215/437] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:44 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:45.570735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:45.571343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:45.577877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:45.578352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:45.578786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:45.579518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:45.579971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:45.580403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:45.709512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:45.717492 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d026c27d-7c15-4bcb-b0f4-890f69eed2b9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.150600 Aug 18 20:57:45.718060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 223/438] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:45 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:45.964343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:45.964877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:45.971620 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:45.972134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:45.972600 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:45.973295 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:45.973787 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:45.974240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:46.026240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:46.026862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:46.033288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:46.033769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:46.034205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:46.034903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:46.035374 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:46.035809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:46.105337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:46.112973 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-57a0b407-8c70-4264-8a68-4c399446969e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.152596 Aug 18 20:57:46.113528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 216/439] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:45 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:46.170375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:46.178024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-56858774-e7f9-4e98-bce6-49f0a06b5cc9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.155842 Aug 18 20:57:46.178585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 224/440] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:46 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:46.738001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:46.738660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:46.741799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:46.745139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:46.745617 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:46.746055 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:46.746830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:46.747284 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:46.747736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:46.878020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:46.885732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-319cac77-9d31-41d3-9991-610fd03e0832 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.151682 Aug 18 20:57:46.886830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 217/441] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:46 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:47.134206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:47.134816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:47.142039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:47.142520 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:47.142963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:47.143682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:47.144146 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:47.144573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:47.198151 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:47.198853 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:47.205951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:47.206426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:47.206849 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:47.207567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:47.208009 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:47.208422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:47.273611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:47.281626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d313ce9a-9616-49e4-917d-c5233566c5f5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.151269 Aug 18 20:57:47.282203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 225/442] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:47 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:47.341894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:47.350172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-662a60d0-02d6-42c3-92f9-8184358c735e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.155465 Aug 18 20:57:47.350440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 218/443] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:47 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:47.906352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:47.907031 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:47.913143 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:47.913655 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:47.914103 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:47.914792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:47.915301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:47.915752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:48.045027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:48.052725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a8aa20da-42e7-48fc-870e-0d7e8749dfa3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.150362 Aug 18 20:57:48.053294 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 226/444] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:47 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:48.302535 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:48.303147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:48.310200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:48.310670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:48.311276 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:48.311821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:48.312272 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:48.312692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:48.369948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:48.370593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:48.381751 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:48.382244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:48.382686 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:48.383424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:48.383884 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:48.384379 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:48.466774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:48.476007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-41a05a33-da22-4108-9503-3ef22f461a8e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.177305 Aug 18 20:57:48.476583 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 219/445] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:48 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:48.526980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:48.535423 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-951b1233-b16a-41d8-9fae-76e4e7967da9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.169297 Aug 18 20:57:48.535994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 227/446] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:48 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:49.073831 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:49.074873 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:49.080954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:49.081437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:49.081870 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:49.082561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:49.083012 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:49.083463 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:49.248108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:49.259272 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-92476c98-9f76-438a-921b-92edc6696f41 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.189312 Aug 18 20:57:49.260087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 220/447] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:49 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:49.499123 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:49.500426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:49.513037 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:49.513961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:49.514496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:49.515393 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:49.516077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:49.516605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:49.561330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:49.561703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:49.569112 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:49.573186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:49.573186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:49.573186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:49.573186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:49.573532 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:49.793320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:49.802020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3b085110-5428-4671-ba02-b219a4fc0fbe tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1271 microversion: 2.1 time: 0.245665 Aug 18 20:57:49.802749 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 221/448] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:49 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1271 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:49.848235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:49.857854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4e506e60-9be9-4be8-8242-6f37c5112250 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.363299 Aug 18 20:57:49.858799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 228/449] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:49 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:50.099290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-9d2d351f-1b18-44cb-adeb-0f547a63ad88 req-392a65fa-c043-4ced-ace2-bc4b1e10a6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36afd51b-5953-4414-8efe-b33c3e8a2fda", "tag": "febcfc1a-0d17-4c46-ba69-4e78e95c42a3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:50.115110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-9d2d351f-1b18-44cb-adeb-0f547a63ad88 req-392a65fa-c043-4ced-ace2-bc4b1e10a6ef service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.115955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-9d2d351f-1b18-44cb-adeb-0f547a63ad88 req-392a65fa-c043-4ced-ace2-bc4b1e10a6ef service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.116575 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-9d2d351f-1b18-44cb-adeb-0f547a63ad88 req-392a65fa-c043-4ced-ace2-bc4b1e10a6ef service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:50.130839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-9d2d351f-1b18-44cb-adeb-0f547a63ad88 req-392a65fa-c043-4ced-ace2-bc4b1e10a6ef service nova] Creating event network-changed:febcfc1a-0d17-4c46-ba69-4e78e95c42a3 for instance 36afd51b-5953-4414-8efe-b33c3e8a2fda on hv-cinder-85265 Aug 18 20:57:50.136908 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-9d2d351f-1b18-44cb-adeb-0f547a63ad88 req-392a65fa-c043-4ced-ace2-bc4b1e10a6ef service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053993 Aug 18 20:57:50.137543 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 222/450] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:50.281461 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:50.282082 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:50.288236 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.288647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.289105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:50.289725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.290176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.290806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:50.460715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-f5428517-5458-4ea8-a06a-b40f22e0f951 req-2b6f60aa-ce16-4268-8cb5-f276752c1f1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18708cef-6c64-4887-a36e-5772b2174015", "tag": "f9d700d2-9284-4783-b567-bf781fc17f3a"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:50.475198 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f5428517-5458-4ea8-a06a-b40f22e0f951 req-2b6f60aa-ce16-4268-8cb5-f276752c1f1a service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.475691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f5428517-5458-4ea8-a06a-b40f22e0f951 req-2b6f60aa-ce16-4268-8cb5-f276752c1f1a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.476118 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f5428517-5458-4ea8-a06a-b40f22e0f951 req-2b6f60aa-ce16-4268-8cb5-f276752c1f1a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:50.488131 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-f5428517-5458-4ea8-a06a-b40f22e0f951 req-2b6f60aa-ce16-4268-8cb5-f276752c1f1a service nova] Creating event network-changed:f9d700d2-9284-4783-b567-bf781fc17f3a for instance 18708cef-6c64-4887-a36e-5772b2174015 on hv-cinder-85265 Aug 18 20:57:50.493162 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-f5428517-5458-4ea8-a06a-b40f22e0f951 req-2b6f60aa-ce16-4268-8cb5-f276752c1f1a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036671 Aug 18 20:57:50.494002 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 223/451] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:50.536051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:50.536051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-053fb244-1dad-490f-ba88-9a29fd51f8eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.258392 Aug 18 20:57:50.548040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 229/452] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:50 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:50.825233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:50.826562 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:50.833741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.834228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.834657 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:50.835378 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.835834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.836260 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:50.882029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:50.883122 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:50.899790 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.900631 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.901312 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:50.902369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:50.903794 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:50.904979 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:51.050116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:51.059622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-486d78be-6858-4d80-ae00-f68a99bd2d44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.238499 Aug 18 20:57:51.060494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 224/453] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:50 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:51.176827 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:51.185517 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f62901ef-f9ec-4fb5-8af8-b97ee9d6b01c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.307768 Aug 18 20:57:51.186232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 230/454] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:50 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:51.557027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:51.557635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:51.569166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:51.569734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:51.570172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:51.571602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:51.572133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:51.573738 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:51.715792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:51.724651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cf99ebe1-3414-44b3-a5fb-7836f3facfc1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.171472 Aug 18 20:57:51.728058 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 225/455] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:51 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:52.080801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:52.081415 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:52.088137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:52.088660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:52.089103 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:52.089798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:52.090256 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:52.090686 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:52.206136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:52.206996 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:52.215753 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:52.216278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:52.216714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:52.217642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:52.218217 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:52.218643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:52.224324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:52.232576 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-51de9947-a140-4920-b4a1-33eadab31935 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.155641 Aug 18 20:57:52.233153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 231/456] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:52 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:52.350313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:52.358691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-08e929d0-97a4-4f10-8e45-4c8079c6ab6d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.156381 Aug 18 20:57:52.359247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 226/457] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:52 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:52.510525 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-e3e6e1d6-4dda-418a-b654-f08218db14f1 req-03e1f6bc-0fdc-487c-a8d6-bda4d04086f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2581e39c-49df-4aa0-8e61-4351d31907d8", "tag": "029a6b88-b666-4955-8888-cf641a23b712"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:52.517104 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:52.528678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e3e6e1d6-4dda-418a-b654-f08218db14f1 req-03e1f6bc-0fdc-487c-a8d6-bda4d04086f2 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:52.528678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e3e6e1d6-4dda-418a-b654-f08218db14f1 req-03e1f6bc-0fdc-487c-a8d6-bda4d04086f2 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:52.528678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e3e6e1d6-4dda-418a-b654-f08218db14f1 req-03e1f6bc-0fdc-487c-a8d6-bda4d04086f2 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:52.534497 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-e3e6e1d6-4dda-418a-b654-f08218db14f1 req-03e1f6bc-0fdc-487c-a8d6-bda4d04086f2 service nova] Creating event network-changed:029a6b88-b666-4955-8888-cf641a23b712 for instance 2581e39c-49df-4aa0-8e61-4351d31907d8 on hv-cinder-85265 Aug 18 20:57:52.540010 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-e3e6e1d6-4dda-418a-b654-f08218db14f1 req-03e1f6bc-0fdc-487c-a8d6-bda4d04086f2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033149 Aug 18 20:57:52.540613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 232/458] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:52.746116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:52.747301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:52.752842 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:52.753321 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:52.753761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:52.754456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:52.754912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:52.755337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:52.889784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:52.898321 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-72bf1b43-c2fb-4cf9-a3f6-5b7fbbdfbb69 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.156066 Aug 18 20:57:52.898887 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 227/459] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:52 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:53.255055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:53.255780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:53.262458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:53.263582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:53.264025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:53.264720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:53.265176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:53.265603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:53.378182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:53.378826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:53.385471 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:53.385957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:53.386397 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:53.387099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:53.387581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:53.388546 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:53.392835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:53.396947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:53.405902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b1c69def-4eac-42d7-a544-7b264cb2e19a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.155549 Aug 18 20:57:53.406470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 233/460] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:53 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:53.520212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:53.528098 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-49ab1b8b-6575-4336-8e8e-3b2f4acad5d6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.153831 Aug 18 20:57:53.529645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 228/461] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:53 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:53.919536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:53.920649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:53.928281 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:53.928281 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:53.928533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:53.929234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:53.929690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:53.930114 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:54.065276 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:54.073020 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d789b8fa-03e8-4a6c-aeab-af88a7362e49 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.157511 Aug 18 20:57:54.073579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 234/462] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:53 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:54.426566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:54.427198 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:54.433918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:54.434400 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:54.435543 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:54.436540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:54.437001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:54.437428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:54.549824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:54.550429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:54.557001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:54.557497 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:54.557967 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:54.558671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:54.559128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:54.559629 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:54.567236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:54.574864 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a057c454-39d6-456d-bd58-220d5faa00de tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.152107 Aug 18 20:57:54.575448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 229/463] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:54 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:54.689707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:54.697310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a2731f2c-152c-4b2b-9435-66b3d3d5667c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.151365 Aug 18 20:57:54.697943 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 235/464] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:54 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:55.094094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:55.094711 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:55.100739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:55.101172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:55.101606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:55.102297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:55.102755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:55.103178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:55.232386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:55.240053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bcb78c2f-4e0c-4426-bc1f-f40a6a180a94 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.149925 Aug 18 20:57:55.240608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 230/465] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:55 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:55.595450 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:55.596066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:55.602782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:55.603007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:55.603471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:55.604174 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:55.604623 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:55.605052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:55.719777 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:55.720454 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:55.728451 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:55.728938 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:55.729372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:55.730567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:55.731157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:55.732264 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:55.737715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:55.746013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-36814c0e-b5d9-41c4-ad43-044758db12a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.154443 Aug 18 20:57:55.746585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 236/466] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:55 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:55.865574 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:55.874040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a0129414-2d39-4850-ae70-3e409ecbe8a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.159666 Aug 18 20:57:55.874607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 231/467] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:55 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:56.261043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:56.261651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:56.268196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:56.268700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:56.269107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:56.269790 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:56.270237 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:56.270651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:56.402153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:56.410075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-21eb766a-2c7b-492c-8431-0a9ab9670a8c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.153098 Aug 18 20:57:56.410637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 237/468] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:56 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:56.766615 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:56.767225 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:56.781722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:56.782718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:56.782718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:56.783299 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:56.783775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:56.784193 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:56.894195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:56.894857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:56.901613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:56.902097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:56.902535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:56.903237 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:56.903725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:56.904152 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:56.918150 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:56.928638 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ae689dfb-5ad3-4149-ad2e-a74cc141fd44 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.165765 Aug 18 20:57:56.929234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 232/469] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:56 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:57.032345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:57.040144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dbb2de25-4f29-41aa-8beb-e113cc0393e9 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.149909 Aug 18 20:57:57.040725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 238/470] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:56 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:57:57.431147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:57.431782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:57.438388 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:57.438860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:57.439291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:57.440066 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:57.440515 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:57.440940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:57.570828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:57.579141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3183dbba-17a3-4483-b549-97707e20c34e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.151800 Aug 18 20:57:57.579714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 233/471] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:57 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:57.682466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-8a2915b0-846b-42b7-83f9-a8f8780acfe5 req-63630ed0-74be-4317-bc5e-24a5513f0155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2581e39c-49df-4aa0-8e61-4351d31907d8", "name": "network-vif-plugged", "status": "completed", "tag": "029a6b88-b666-4955-8888-cf641a23b712"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:57:57.693382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8a2915b0-846b-42b7-83f9-a8f8780acfe5 req-63630ed0-74be-4317-bc5e-24a5513f0155 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:57.693867 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8a2915b0-846b-42b7-83f9-a8f8780acfe5 req-63630ed0-74be-4317-bc5e-24a5513f0155 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:57.694306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8a2915b0-846b-42b7-83f9-a8f8780acfe5 req-63630ed0-74be-4317-bc5e-24a5513f0155 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:57.706287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-8a2915b0-846b-42b7-83f9-a8f8780acfe5 req-63630ed0-74be-4317-bc5e-24a5513f0155 service nova] Creating event network-vif-plugged:029a6b88-b666-4955-8888-cf641a23b712 for instance 2581e39c-49df-4aa0-8e61-4351d31907d8 on hv-cinder-85265 Aug 18 20:57:57.711456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-8a2915b0-846b-42b7-83f9-a8f8780acfe5 req-63630ed0-74be-4317-bc5e-24a5513f0155 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033047 Aug 18 20:57:57.712080 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 239/472] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:57:57.949159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:57.949791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:57.956161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:57.956641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:57.957076 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:57.957770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:57.958224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:57.958655 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:58.061410 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:58.062780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:58.068993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:58.069619 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:58.070131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:58.070845 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:58.071300 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:58.071765 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:58.076466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:58.089936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:58.098865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3a0fb947-6e84-455b-8355-8a8cc2ddbb2a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.153554 Aug 18 20:57:58.111349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 234/473] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:57 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:58.249144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:58.256928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c1fdc383-1492-4ab9-ae68-9d62a0d3ec62 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.200179 Aug 18 20:57:58.260155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 240/474] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:58 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:58.600364 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:58.600981 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:58.606962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:58.607478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:58.607917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:58.608684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:58.609139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:58.609608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:58.740073 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:58.747604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2e69ad9a-4670-43fe-93e2-864ef9b6f7f5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.151148 Aug 18 20:57:58.748169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 235/475] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:58 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:59.123929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:59.125099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:59.131547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:59.132034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:59.132477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:59.133166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:59.133627 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:59.134054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:59.261739 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:59.270475 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d50cc8cb-39d7-4395-aabd-17c3f409dc2f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.150383 Aug 18 20:57:59.271047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 241/476] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:59 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:59.278856 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:59.279493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:59.286108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:59.286587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:59.287018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:59.287751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:59.288198 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:59.288631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:59.422722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:59.430502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8c1e7cd5-7313-4728-a48f-49e39e5b1387 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.155625 Aug 18 20:57:59.431065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 236/477] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:59 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:57:59.768012 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:57:59.768770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:57:59.775701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:59.776097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:59.776523 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:59.777216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:57:59.777661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:57:59.778134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:57:59.912360 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:57:59.920044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0070e4dd-a9b7-4b28-90ac-ea33f9f5ae2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.156039 Aug 18 20:57:59.923030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 242/478] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:57:59 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:00.291304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:00.292007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:00.298357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:00.298836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:00.299272 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:00.299996 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:00.300451 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:00.300876 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:00.434307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:00.442565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-223c772c-add0-43ed-8502-b95f4d2df4b4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.155263 Aug 18 20:58:00.443126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 237/479] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:00 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:00.452194 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:00.453500 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:00.460357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:00.460888 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:00.461321 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:00.462041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:00.462487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:00.462932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:00.589381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:00.597109 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-eb3f1113-87a6-484b-b50a-3847e9b8aae4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.148804 Aug 18 20:58:00.597667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 243/480] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:00 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:00.941470 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:00.942158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:00.948125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:00.948615 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:00.949053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:00.949747 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:00.950201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:00.950623 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:01.080351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:01.088403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-95695041-8fcb-4161-a368-caa9c30a0eae tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.150870 Aug 18 20:58:01.088952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 238/481] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:00 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:01.464195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:01.464821 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:01.471431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:01.471968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:01.472364 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:01.473069 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:01.473518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:01.473943 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:01.614009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:01.617229 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:01.620241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:01.621994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8b519227-dba5-4eff-bf4b-74abdc52f8db tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.161680 Aug 18 20:58:01.622601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 244/482] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:01 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:01.624284 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:01.624775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:01.625202 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:01.625894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:01.626336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:01.626752 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:01.755329 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:01.762973 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4aab8ba5-ba6b-4437-bb59-4f770c6c5057 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1358 microversion: 2.1 time: 0.149572 Aug 18 20:58:01.763580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 239/483] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:01 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:02.110504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:02.111023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:02.117057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.117543 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.117980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:02.118671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.119146 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.119616 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:02.250009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:02.258175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2b6db920-eb79-4919-b04d-fec80edffd42 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.151724 Aug 18 20:58:02.258723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 245/484] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:02 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:02.642495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:02.643122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:02.649498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.650251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.650683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:02.651387 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.651850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.652278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:02.784103 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:02.784709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:02.785473 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:02.791142 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.791646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.792079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:02.792763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.793208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.793498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1adf80e6-a089-469a-927b-dd0bc0c75fb8 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.154893 Aug 18 20:58:02.793618 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:02.794060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 240/485] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:02 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:02.924638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:02.932367 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ad5e4378-f122-486a-a683-1525ff821b61 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1547 microversion: 2.1 time: 0.152681 Aug 18 20:58:02.932937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 246/486] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:02 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:02.952531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:02.953135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:02.958948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.959452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.959881 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:02.960564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:02.961002 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:02.961416 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.089416 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:03.097796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b26ed428-1994-4a83-88a4-cd4f0224ed5c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1547 microversion: 2.1 time: 0.148936 Aug 18 20:58:03.098365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 241/487] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:02 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:03.117021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:03.122028 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:03.122803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Searching by: {'deleted': False, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b'} {{(pid=127936) get_all /opt/stack/nova/nova/compute/api.py:3007}} Aug 18 20:58:03.129406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.129893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.130331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.131059 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.131547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.131976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.224369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.multi_cell_list [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127936) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 20:58:03.278379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:03.279126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:03.286071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.286589 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.287242 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.287979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.288433 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.288858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.323266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b2d41820-5daa-4985-87d6-872cda784912 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210029 Aug 18 20:58:03.323966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 247/488] 10.222.0.62 () {58 vars in 1125 bytes} [Thu Aug 18 20:58:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:03.329067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-cd14bf29-1040-4a34-9d2e-a94f31ed6207 req-b863d855-47be-4274-9cd4-590a7074991a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18708cef-6c64-4887-a36e-5772b2174015", "name": "network-vif-plugged", "status": "completed", "tag": "f9d700d2-9284-4783-b567-bf781fc17f3a"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:03.339184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cd14bf29-1040-4a34-9d2e-a94f31ed6207 req-b863d855-47be-4274-9cd4-590a7074991a service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.339689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cd14bf29-1040-4a34-9d2e-a94f31ed6207 req-b863d855-47be-4274-9cd4-590a7074991a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.340128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cd14bf29-1040-4a34-9d2e-a94f31ed6207 req-b863d855-47be-4274-9cd4-590a7074991a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.351733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-cd14bf29-1040-4a34-9d2e-a94f31ed6207 req-b863d855-47be-4274-9cd4-590a7074991a service nova] Creating event network-vif-plugged:f9d700d2-9284-4783-b567-bf781fc17f3a for instance 18708cef-6c64-4887-a36e-5772b2174015 on hv-cinder-85265 Aug 18 20:58:03.357156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-cd14bf29-1040-4a34-9d2e-a94f31ed6207 req-b863d855-47be-4274-9cd4-590a7074991a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 Aug 18 20:58:03.357754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 248/489] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:03.363759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:03.363759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:03.370580 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.371076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.371548 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.372247 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.372702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.373132 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.449090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:03.459185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1e2aa69e-8d93-4f7d-8db2-ee0e6c40da66 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.184900 Aug 18 20:58:03.464911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 242/490] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:03 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:03.528772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:03.536508 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8f4606fc-bce6-4f10-9eb4-af91afaa6df6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1547 microversion: 2.1 time: 0.177675 Aug 18 20:58:03.537128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 249/491] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:03 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:03.814962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:03.815734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:03.822337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.822825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.823257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.823988 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:03.824442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:03.824867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:03.966915 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:03.974944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f9d3bdda-bd65-46f3-9715-5ac0f5f26d80 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.164239 Aug 18 20:58:03.975429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 243/492] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:03 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:04.479595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:04.480230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:04.487220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:04.487734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:04.488174 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:04.488866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:04.489317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:04.489741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:04.625888 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:04.633766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-48662393-e8af-468d-acbc-e2654bd4385f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.158233 Aug 18 20:58:04.634325 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 250/493] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:04 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:04.995952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:04.996479 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:05.003123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:05.003633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:05.004069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:05.004764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:05.005219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:05.005642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:05.135595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:05.138980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:05.144087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-11bf07cd-4d1d-4e66-9f97-cf9f704d20b9 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.152157 Aug 18 20:58:05.144647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 244/494] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:04 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:05.371393 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-b1448c58-942d-44df-8c99-c6bce2f91cc3 req-bc796acf-ac8f-4181-ab35-263f2404af34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36afd51b-5953-4414-8efe-b33c3e8a2fda", "name": "network-vif-plugged", "status": "completed", "tag": "febcfc1a-0d17-4c46-ba69-4e78e95c42a3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:05.381670 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-b1448c58-942d-44df-8c99-c6bce2f91cc3 req-bc796acf-ac8f-4181-ab35-263f2404af34 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:05.382125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-b1448c58-942d-44df-8c99-c6bce2f91cc3 req-bc796acf-ac8f-4181-ab35-263f2404af34 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:05.382591 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-b1448c58-942d-44df-8c99-c6bce2f91cc3 req-bc796acf-ac8f-4181-ab35-263f2404af34 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:05.393872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-b1448c58-942d-44df-8c99-c6bce2f91cc3 req-bc796acf-ac8f-4181-ab35-263f2404af34 service nova] Creating event network-vif-plugged:febcfc1a-0d17-4c46-ba69-4e78e95c42a3 for instance 36afd51b-5953-4414-8efe-b33c3e8a2fda on hv-cinder-85265 Aug 18 20:58:05.398708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-b1448c58-942d-44df-8c99-c6bce2f91cc3 req-bc796acf-ac8f-4181-ab35-263f2404af34 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030934 Aug 18 20:58:05.400195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 251/495] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:05.655270 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:05.655910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:05.662845 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:05.663460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:05.663921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:05.664695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:05.665162 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:05.665589 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:05.805629 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:05.813515 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4c6500c3-6f33-4654-b4ff-26a83ccb218d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1365 microversion: 2.1 time: 0.162201 Aug 18 20:58:05.814120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 245/496] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:05 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:06.167049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:06.167766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:06.173870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:06.174357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:06.174791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:06.175571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:06.176024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:06.176456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:06.380382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:06.388986 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-03dd4382-81b1-49bd-8b7f-8fcb96b823ff tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.226672 Aug 18 20:58:06.389647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 252/497] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:06 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:06.669631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d66112f5-1b39-4ced-be2e-314061918ff1"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:06.672128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:06.678751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:06.719531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:06.719531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:06.719531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:06.719531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:06.720080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:06.834225 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:06.834853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:06.841004 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:06.841482 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:06.841929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:06.842596 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:06.843039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:06.843485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:07.151092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:07.159405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-62c4fb75-e50a-4760-9a98-e88c2779b775 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1556 microversion: 2.1 time: 0.329040 Aug 18 20:58:07.159967 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 253/498] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:06 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1556 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:07.180657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:07.181290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:07.187216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:07.187768 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:07.188199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:07.188878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:07.189324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:07.189741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:07.269420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f6f5cff0-c60e-4c94-b79a-6bbaf644e42f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092247 Aug 18 20:58:07.270012 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 254/499] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 20:58:07 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:58:07.410692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:07.411644 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:07.418289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:07.418772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:07.419205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:07.419935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:07.420383 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:07.420799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:07.646889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:07.654948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1d7932c7-8159-436d-8b50-1372a1fa6bed tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1259 microversion: 2.1 time: 0.248746 Aug 18 20:58:07.655551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 255/500] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:07 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:08.314144 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2ceba52d-0e5c-4ff4-8d67-78afec5b059a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.654066 Aug 18 20:58:08.319788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 246/501] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 20:58:06 2022] POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments => generated 194 bytes in 1656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:08.678049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:08.678810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:08.686551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:08.687544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:08.688134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:08.688931 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:08.689524 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:08.690046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:08.873504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-0f86de92-1334-4d89-97bd-d31c7f647c1c req-91b9b4ef-d916-47eb-8caa-ca48cf771746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18708cef-6c64-4887-a36e-5772b2174015", "tag": "f9d700d2-9284-4783-b567-bf781fc17f3a"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:08.885238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0f86de92-1334-4d89-97bd-d31c7f647c1c req-91b9b4ef-d916-47eb-8caa-ca48cf771746 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:08.886213 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0f86de92-1334-4d89-97bd-d31c7f647c1c req-91b9b4ef-d916-47eb-8caa-ca48cf771746 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:08.887053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0f86de92-1334-4d89-97bd-d31c7f647c1c req-91b9b4ef-d916-47eb-8caa-ca48cf771746 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:08.895094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:08.909998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c6b9dbb5-f962-4458-8528-4bef56fe9796 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1443 microversion: 2.1 time: 0.237504 Aug 18 20:58:08.915515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 256/502] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:08 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1443 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:08.918041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-0f86de92-1334-4d89-97bd-d31c7f647c1c req-91b9b4ef-d916-47eb-8caa-ca48cf771746 service nova] Creating event network-changed:f9d700d2-9284-4783-b567-bf781fc17f3a for instance 18708cef-6c64-4887-a36e-5772b2174015 on hv-cinder-85265 Aug 18 20:58:08.929108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-0f86de92-1334-4d89-97bd-d31c7f647c1c req-91b9b4ef-d916-47eb-8caa-ca48cf771746 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060575 Aug 18 20:58:08.929909 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 247/503] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:58:08.932800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:08.933448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:08.940568 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:08.941065 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:08.941503 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:08.942204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:08.942657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:08.943092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:09.166950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:09.176268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c24b471f-94c8-4078-a92e-983e8d3dedbb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1443 microversion: 2.1 time: 0.247622 Aug 18 20:58:09.176959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 257/504] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:08 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1443 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:10.368446 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:10.369051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:10.375239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:10.375768 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:10.376206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:10.376907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:10.377363 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:10.377788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:10.401704 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c33f144d-82cf-432e-87cd-2b868605455c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/ips" status: 200 len: 152 microversion: 2.20 time: 0.037953 Aug 18 20:58:10.402282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 248/505] 10.222.0.62 () {60 vars in 1289 bytes} [Thu Aug 18 20:58:10 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 20:58:11.428119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-1f125c0a-5c42-451d-abeb-833f5ead6de7 req-df1ce8c1-7d4d-49ca-addc-83fc9d0a7b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36afd51b-5953-4414-8efe-b33c3e8a2fda", "tag": "febcfc1a-0d17-4c46-ba69-4e78e95c42a3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:11.440124 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1f125c0a-5c42-451d-abeb-833f5ead6de7 req-df1ce8c1-7d4d-49ca-addc-83fc9d0a7b3f service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:11.440744 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1f125c0a-5c42-451d-abeb-833f5ead6de7 req-df1ce8c1-7d4d-49ca-addc-83fc9d0a7b3f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:11.441435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1f125c0a-5c42-451d-abeb-833f5ead6de7 req-df1ce8c1-7d4d-49ca-addc-83fc9d0a7b3f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:11.445664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:11.453646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-1f125c0a-5c42-451d-abeb-833f5ead6de7 req-df1ce8c1-7d4d-49ca-addc-83fc9d0a7b3f service nova] Creating event network-changed:febcfc1a-0d17-4c46-ba69-4e78e95c42a3 for instance 36afd51b-5953-4414-8efe-b33c3e8a2fda on hv-cinder-85265 Aug 18 20:58:11.458805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-1f125c0a-5c42-451d-abeb-833f5ead6de7 req-df1ce8c1-7d4d-49ca-addc-83fc9d0a7b3f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034351 Aug 18 20:58:11.459502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 258/506] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:13.874300 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:13.874885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:13.881904 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:13.882389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:13.882827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:13.883649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:13.884108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:13.884536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:13.907717 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lazy-loading 'flavor' on Instance uuid 36c76af8-35e8-4dbe-885d-cb5510af2411 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:58:14.423725 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9ef74eda-03f1-4991-a8e1-f721734e2ed2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/action" status: 202 len: 0 microversion: 2.20 time: 0.552907 Aug 18 20:58:14.424308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 249/507] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Aug 18 20:58:13 2022] POST /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/action => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 20:58:14.430357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:14.434913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:14.435635 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:14.442566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:14.442994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:14.443454 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:14.444206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:14.444694 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:14.445089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:14.574045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:14.582106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:14.583611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:14.584754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d453e8a7-acab-4667-befe-5dd4c5efb690 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.155885 Aug 18 20:58:14.585303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 259/508] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:14 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:15.609353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:15.609966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:15.617165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:15.617745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:15.618283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:15.619007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:15.619485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:15.619917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:15.753724 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:15.761940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:15.763568 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:15.764736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-da966ad8-fd55-461c-820a-45d8f6cf3b75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.160487 Aug 18 20:58:15.765281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 250/509] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:15 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:16.788363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:16.789049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:16.796017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:16.796565 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:16.797046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:16.797877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:16.798383 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:16.798877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:16.942406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:16.950771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:16.952302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:16.953462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4ba9a0d7-5f6b-4e01-bfbe-825cb98bc868 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.170210 Aug 18 20:58:16.954035 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 260/510] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:16 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:16.993302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:16.998805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:17.007238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=67 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:17.008029 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:17.008334 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:17.008802 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:17.009796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:17.010148 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:17.010601 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:17.145496 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:17.154086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-baa779c4-71fe-4a95-ad99-44fe52835187 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1593 microversion: 2.1 time: 0.164877 Aug 18 20:58:17.154654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 251/511] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:16 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1593 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:17.976805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:17.977420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:17.984050 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:17.984538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:17.984972 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:17.985684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:17.986121 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:17.986549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:18.209678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:18.218093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:18.219610 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:18.220770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-638a3492-eb66-4d02-b615-cba656be40e4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.247819 Aug 18 20:58:18.221585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 261/512] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:17 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:19.244123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:19.244765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:19.255160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:19.255651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:19.256106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:19.258581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:19.258581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:19.258581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:19.394236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:19.408283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:19.408283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:19.408923 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-832873db-ad4d-4bf8-b23a-03b4762bab0e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.168360 Aug 18 20:58:19.409570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 252/513] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:19 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:19.627055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-52996010-df26-44ee-9095-2a3753a6298c req-9021de75-3870-4648-941c-bca56637acd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2581e39c-49df-4aa0-8e61-4351d31907d8", "tag": "029a6b88-b666-4955-8888-cf641a23b712"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:19.639164 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-52996010-df26-44ee-9095-2a3753a6298c req-9021de75-3870-4648-941c-bca56637acd0 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:19.640198 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-52996010-df26-44ee-9095-2a3753a6298c req-9021de75-3870-4648-941c-bca56637acd0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:19.640735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-52996010-df26-44ee-9095-2a3753a6298c req-9021de75-3870-4648-941c-bca56637acd0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:19.655072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-52996010-df26-44ee-9095-2a3753a6298c req-9021de75-3870-4648-941c-bca56637acd0 service nova] Creating event network-changed:029a6b88-b666-4955-8888-cf641a23b712 for instance 2581e39c-49df-4aa0-8e61-4351d31907d8 on hv-cinder-85265 Aug 18 20:58:19.660834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-52996010-df26-44ee-9095-2a3753a6298c req-9021de75-3870-4648-941c-bca56637acd0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037334 Aug 18 20:58:19.661537 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 262/514] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:20.432167 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:20.433807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:20.440811 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:20.441291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:20.441729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:20.442424 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:20.442867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:20.443283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:20.577838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:20.586521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:20.588044 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:20.589277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bf2b9013-f598-40ed-809d-b2cff9e3e20f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.161463 Aug 18 20:58:20.589826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 253/515] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:20 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:21.613464 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:21.618243 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:21.620705 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:21.621188 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:21.621617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:21.622338 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:21.622783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:21.623202 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:21.759190 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:21.767626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:21.769049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:21.770199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-947b1319-181f-4bda-aaa2-d721e636d8b2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.161696 Aug 18 20:58:21.770756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 263/516] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:21 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:22.345024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-180949086"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:22.345632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:22.352928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:22.353410 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:22.353835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:22.354528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:22.354978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:22.355421 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:22.482980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.network.security_group_api [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Adding security group b927f3ad-da64-445b-9005-3385b839db89 to port 029a6b88-b666-4955-8888-cf641a23b712 Aug 18 20:58:22.792923 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:22.793521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:22.800221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:22.800768 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:22.801231 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:22.801924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:22.802370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:22.802789 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:22.932947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:22.940745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-06b627e7-ac5f-48fc-91f8-ed9d4e9c72d7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/action" status: 202 len: 0 microversion: 2.1 time: 0.599593 Aug 18 20:58:22.942094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 254/517] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 20:58:22 2022] POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 20:58:22.942839 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:22.944465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:22.950060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:22.950680 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:22.954576 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-56b381f8-5eaa-4043-b58c-77596d947d52 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.165386 Aug 18 20:58:22.955586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 264/518] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:22 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:22.962466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-82532d53-7d95-45e4-9c85-9839ee00d1f0 req-38b49393-e94d-41c9-968e-ecff96f59580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2581e39c-49df-4aa0-8e61-4351d31907d8", "tag": "029a6b88-b666-4955-8888-cf641a23b712"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:22.969695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:22.970430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:22.971031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:22.971962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:22.972422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:22.972859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:22.979671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-82532d53-7d95-45e4-9c85-9839ee00d1f0 req-38b49393-e94d-41c9-968e-ecff96f59580 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:22.980153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-82532d53-7d95-45e4-9c85-9839ee00d1f0 req-38b49393-e94d-41c9-968e-ecff96f59580 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:22.981438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-82532d53-7d95-45e4-9c85-9839ee00d1f0 req-38b49393-e94d-41c9-968e-ecff96f59580 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:23.006345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-82532d53-7d95-45e4-9c85-9839ee00d1f0 req-38b49393-e94d-41c9-968e-ecff96f59580 service nova] Creating event network-changed:029a6b88-b666-4955-8888-cf641a23b712 for instance 2581e39c-49df-4aa0-8e61-4351d31907d8 on hv-cinder-85265 Aug 18 20:58:23.017088 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-82532d53-7d95-45e4-9c85-9839ee00d1f0 req-38b49393-e94d-41c9-968e-ecff96f59580 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060090 Aug 18 20:58:23.017840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 265/519] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:23.177635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:23.186955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d92ad35f-f30e-4394-96d8-ba12a774d7d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1758 microversion: 2.1 time: 0.240772 Aug 18 20:58:23.195430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 255/520] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:22 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1758 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:58:23.979192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:23.979904 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:23.981948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=67 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:23.987216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:23.988225 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:23.988670 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:23.989365 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:23.989810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:23.990292 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:24.144317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:24.153293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:24.154798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:24.155985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-31fb3a19-b83c-4f1b-a624-c1353c195a85 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.181540 Aug 18 20:58:24.156543 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 266/521] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:23 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:25.178978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:25.179605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:25.186237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:25.186718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:25.187152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:25.187877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:25.188331 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:25.188755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:25.323630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:25.332403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:25.333914 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:25.335076 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b6273f8f-192f-401a-a9ba-22351b949a1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.160114 Aug 18 20:58:25.335656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 256/522] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:25 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:26.359106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:26.360075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:26.366414 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:26.366892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:26.367321 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:26.368043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:26.368860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:26.369288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:26.497681 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:26.505915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:26.507436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:26.508586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0aea81c4-58e8-4c2a-806e-1b878c907c59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.153385 Aug 18 20:58:26.509146 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 267/523] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:26 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:27.532070 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:27.532700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:27.539183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:27.539700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:27.540134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:27.540819 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:27.541271 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:27.541699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:27.671465 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:27.680103 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:27.681670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:27.682821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-08b6c246-1c07-49ec-8f43-593af2ec00b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.154695 Aug 18 20:58:27.683388 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 257/524] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:27 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:28.705695 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:28.706215 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:28.713394 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:28.713907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:28.714346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:28.715044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:28.715646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:28.716085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:28.851961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:28.860095 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:28.861599 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:28.862742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-866091d7-2690-4a21-a4c1-9073bfb5254d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.161012 Aug 18 20:58:28.863301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 268/525] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:28 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:29.885379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:29.886067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:29.893187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:29.893752 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:29.894961 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:29.897377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:29.897377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:29.897705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:30.038715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:30.046840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:30.048380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:30.049538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2ec00a63-f853-4d4b-b12d-b34610d293d9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.168178 Aug 18 20:58:30.050088 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 258/526] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:29 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:58:31.073534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:31.074375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:31.080541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:31.081026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:31.081459 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:31.082151 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:31.082641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:31.083633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:31.214530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:31.222698 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:31.224231 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:31.225410 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8e98fdee-bd53-4868-99ed-003c2980cfe1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.155810 Aug 18 20:58:31.225969 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 269/527] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:31 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:32.247411 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:32.248035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:32.254505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:32.254980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:32.255507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:32.256193 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:32.256642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:32.257059 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:32.274972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:32.389429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:32.397989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:32.399490 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:32.400631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e2cb9b81-1f4b-4b8c-bd6b-23545b3d7c6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.157217 Aug 18 20:58:32.401428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 259/528] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:32 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:33.424402 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:33.425032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:33.431612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:33.432098 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:33.432536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:33.433225 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:33.433686 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:33.434110 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:33.562052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:33.570625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:33.572156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:33.573331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0627e109-328c-4043-9e6c-3446fdf8fea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.152842 Aug 18 20:58:33.573895 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 270/529] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:33 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:34.598381 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:34.599114 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:34.610633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:34.611808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:34.612277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:34.612979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:34.613424 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:34.613836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:34.743503 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:34.752074 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:34.753805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:34.755533 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-95454196-4b2c-456c-9e4d-b99a74ef6def tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.161173 Aug 18 20:58:34.771252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 260/530] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:34 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:35.778419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:35.779033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:35.785467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:35.786457 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:35.786893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:35.787621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:35.788077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:35.788504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:35.920963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:35.929040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:35.930534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:35.931717 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-599e64c5-69b9-4d58-8b70-1c5690f0d0b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.157552 Aug 18 20:58:35.932277 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 271/531] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:35 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:36.446351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-e1bf3aff-d7b9-4c6c-a2f1-078ef6b5629e req-f528b5e5-a0ff-408e-9676-e23e55f2755a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c76af8-35e8-4dbe-885d-cb5510af2411", "name": "network-vif-plugged", "status": "completed", "tag": "2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:36.457993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-e1bf3aff-d7b9-4c6c-a2f1-078ef6b5629e req-f528b5e5-a0ff-408e-9676-e23e55f2755a service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:36.457993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-e1bf3aff-d7b9-4c6c-a2f1-078ef6b5629e req-f528b5e5-a0ff-408e-9676-e23e55f2755a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:36.457993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-e1bf3aff-d7b9-4c6c-a2f1-078ef6b5629e req-f528b5e5-a0ff-408e-9676-e23e55f2755a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:36.468426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-e1bf3aff-d7b9-4c6c-a2f1-078ef6b5629e req-f528b5e5-a0ff-408e-9676-e23e55f2755a service nova] Creating event network-vif-plugged:2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca for instance 36c76af8-35e8-4dbe-885d-cb5510af2411 on hv-cinder-85265 Aug 18 20:58:36.474334 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-e1bf3aff-d7b9-4c6c-a2f1-078ef6b5629e req-f528b5e5-a0ff-408e-9676-e23e55f2755a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031030 Aug 18 20:58:36.474960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 261/532] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:36.742562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a4cb13e-cc58-444f-8eea-50c57be2a1d5"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:36.745023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:36.751086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:36.751611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:36.752080 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:36.752773 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:36.753224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:36.753676 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:36.954564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:36.955316 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:36.961611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:36.966335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:36.966335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:36.966335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:36.966335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:36.966744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:37.097367 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:37.106635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:37.109489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:37.109489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0f0d6e85-8573-4f3b-889a-64e95fbabbd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.159029 Aug 18 20:58:37.109991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 262/533] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:36 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:37.753719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bf45a8e4-4729-4b95-8175-33681efeac1d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.115764 Aug 18 20:58:37.754385 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 272/534] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 20:58:36 2022] POST /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments => generated 194 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:58:38.132984 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:38.133516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:38.140138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:38.140631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:38.141066 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:38.141759 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:38.142211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:38.142635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:38.269754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:38.278728 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:38.280253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:38.281409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e07bb978-b3fa-410c-a48a-851bc3ef47e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.152447 Aug 18 20:58:38.281958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 263/535] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:38 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:39.306845 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:39.307480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:39.314139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:39.314699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:39.315111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:39.315845 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:39.316293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:39.316721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:39.445785 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:39.458623 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:39.461283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:39.461411 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-61f68994-0641-4cec-8dc5-45847d9d92b7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.159464 Aug 18 20:58:39.461870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 273/536] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:39 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:40.484113 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:40.484719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:40.491807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:40.492283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:40.492716 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:40.493395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:40.493838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:40.494261 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:40.626924 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:40.635797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:40.637330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:40.638493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1d846a70-b588-435a-b9be-c12cedaed0e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1745 microversion: 2.20 time: 0.158351 Aug 18 20:58:40.639050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 264/537] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:40 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:41.662053 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:41.663852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:41.672198 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:41.672938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:41.673574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:41.674449 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:41.675066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:41.675675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:42.125865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:42.147776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:42.149315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:42.150483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a16b894a-8dda-4d7f-b97c-681a6b507845 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.492544 Aug 18 20:58:42.151043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 274/538] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:41 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:43.174222 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:43.174860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:43.182317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:43.182811 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:43.183252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:43.183986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:43.184437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:43.184861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:43.325225 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:43.333978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:43.336408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:43.337300 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b38bf715-6611-4c09-b73d-ebfdda399317 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.166916 Aug 18 20:58:43.337943 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 265/539] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:43 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:44.362527 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:44.363297 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:44.371732 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:44.371970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:44.372483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:44.373221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:44.373666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:44.374173 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:44.394606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:44.525159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:44.533861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:44.535354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:44.536522 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b5ce3db9-41bc-400c-b20c-33fd1a1d5ea7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.178618 Aug 18 20:58:44.537085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 275/540] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:44 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:45.561228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:45.562492 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:45.569051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:45.570090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:45.570090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:45.571304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:45.571857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:45.572285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:45.719443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:45.729008 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:45.731741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:45.731880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0e757bd7-7aa5-430d-a5b4-39ee1a7d1c93 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.174741 Aug 18 20:58:45.747393 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 266/541] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:45 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:46.389387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:46.391692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:46.403299 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:46.413797 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:46.414862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:46.415948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:46.416722 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:46.417810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:46.445068 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lazy-loading 'flavor' on Instance uuid 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 20:58:46.755338 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:46.755942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:46.763272 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:46.763793 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:46.772329 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:46.773943 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:46.774595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:46.775032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:46.836786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dbcaf4c3-47fb-4c22-aa30-a36511995680 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/action" status: 200 len: 32 microversion: 2.1 time: 0.450632 Aug 18 20:58:46.837764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 276/542] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 20:58:46 2022] POST /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/action => generated 32 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 20:58:46.847826 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:46.848517 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:46.854893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:46.855381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:46.855831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:46.856538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:46.857004 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:46.857430 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:46.942839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:46.952545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:46.955426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:46.956472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5a217358-6e48-442f-b9a3-7de0db3572a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.205184 Aug 18 20:58:46.957249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 267/543] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:46 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:58:47.054878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:47.064074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4e7be7a1-9b74-48f4-8536-6a135a533902 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.220510 Aug 18 20:58:47.078756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 277/544] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:46 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:47.981780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:47.982346 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:47.984913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=34 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:47.990384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:47.991047 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:47.992061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:47.998342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:47.998342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:47.998342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:48.086665 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:48.087470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:48.094983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:48.095645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:48.096179 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:48.097092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:48.097562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:48.098255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:48.172022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:48.187517 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:48.188989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:48.190207 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c3889eda-5821-412d-8dbd-2ef8cd94160c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.212676 Aug 18 20:58:48.190815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 268/545] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:47 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:58:48.283687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:48.292871 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-90e72118-f2d5-423e-91f1-c891bfc58181 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.210819 Aug 18 20:58:48.293465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 278/546] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:48 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:49.214808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:49.215429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:49.222674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:49.223156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:49.223631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:49.224336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:49.224784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:49.225204 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:49.317264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:49.318847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:49.329675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:49.330438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:49.331110 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:49.332053 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:49.332730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:49.333388 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:49.389554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:49.402489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:49.403970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:49.405238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ee135298-e51a-44e8-969e-0e9b3fc767a5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.195110 Aug 18 20:58:49.406098 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 269/547] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:49 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:49.512070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:49.525330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d9861deb-052c-4c7c-b9b8-c7e5d468a183 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.213046 Aug 18 20:58:49.535534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 279/548] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:49 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:50.428020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:50.429380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:50.436912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:50.437756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:50.438199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:50.438907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:50.439391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:50.439830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:50.546158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:50.546987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:50.557317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:50.558195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:50.558870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:50.559857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:50.560529 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:50.561162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:50.587957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:50.598729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:50.602062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:50.604066 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fd76303b-a51d-44aa-ba73-ef7a0db1f5e0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.179822 Aug 18 20:58:50.619725 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 270/549] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:50 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:50.711301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:50.719637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2b90b0d3-e343-4767-9c24-4c3232d219bc tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.177266 Aug 18 20:58:50.720217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 280/550] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:50 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:51.637228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:51.637817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:51.644520 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:51.645011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:51.645446 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:51.646158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:51.646639 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:51.647100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:51.741363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:51.741983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:51.748907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:51.749421 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:51.749866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:51.750632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:51.751110 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:51.751588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:51.784646 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:51.794139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:51.796171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:51.797357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8ad85371-af5e-45d1-bd46-14335d40b0f2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.164624 Aug 18 20:58:51.797912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 271/551] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:51 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:51.886013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:51.894310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-871670a0-fccd-42c0-838b-40c03eb0f0c0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.156669 Aug 18 20:58:51.894848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 281/552] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:51 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:52.821206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:52.822068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:52.829176 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:52.832341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:52.832341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:52.832341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:52.832341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:52.832719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:52.915865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:52.916651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:52.927269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:52.928064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:52.930587 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:52.931493 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:52.932063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:52.933934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:52.981285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:52.991642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:52.994033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:52.995302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-96b0eee4-69db-4983-842e-057f03eb375f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.178667 Aug 18 20:58:52.995907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 272/553] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:52 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:53.106516 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:53.114661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c139ed09-855e-4c40-afd2-878d21159851 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.203016 Aug 18 20:58:53.115225 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 282/554] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:52 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:54.019574 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:54.020245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:54.027391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:54.027879 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:54.028323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:54.029019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:54.029499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:54.029930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:54.137251 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:54.138023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:54.140501 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=34 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:54.145315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:54.145802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:54.146239 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:54.146942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:54.147416 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:54.147846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:54.157666 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:54.166319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:54.167828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:54.169113 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3b8434fc-ce43-4fb2-80ba-c6f5cac82620 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1740 microversion: 2.20 time: 0.153510 Aug 18 20:58:54.169674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 273/555] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:54 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:54.279061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:54.287264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c10fa100-d1d8-4800-b77e-882be4995450 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.154536 Aug 18 20:58:54.287853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 283/556] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:54 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:55.193062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:55.193600 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:55.200709 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:55.201188 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:55.201624 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:55.202318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:55.202768 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:55.203192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:55.309792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:55.310565 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:55.316990 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:55.317477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:55.317919 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:55.318634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:55.319075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:55.319533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:55.337342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:55.345741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:55.347214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:55.348403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-56db3472-0ea3-4990-831a-b0796b7893e3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1722 microversion: 2.20 time: 0.159490 Aug 18 20:58:55.348950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 274/557] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:55 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:55.464035 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:55.472564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-acb939ac-a20b-406f-a7eb-a89184186ab9 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.167229 Aug 18 20:58:55.473133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 284/558] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:55 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:56.372049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:56.373036 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:56.379305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:56.379817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:56.380252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:56.380940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:56.381394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:56.381818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:56.495198 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:56.496003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:56.502805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:56.503440 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:56.503886 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:56.504582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:56.505030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:56.505601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:56.512828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:56.522545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:56.524570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:56.525910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3bd9ac26-5398-40d1-8be6-eae9eef34a59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1722 microversion: 2.20 time: 0.158502 Aug 18 20:58:56.526581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 275/559] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:56 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:56.570684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-c49abbe4-7e53-4d80-9e27-751d00495d8b req-3ff7c7e5-568f-4b21-a6c1-e849bf88f1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c76af8-35e8-4dbe-885d-cb5510af2411", "name": "network-vif-unplugged", "status": "completed", "tag": "2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:56.580088 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-c49abbe4-7e53-4d80-9e27-751d00495d8b req-3ff7c7e5-568f-4b21-a6c1-e849bf88f1ec service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:56.580568 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-c49abbe4-7e53-4d80-9e27-751d00495d8b req-3ff7c7e5-568f-4b21-a6c1-e849bf88f1ec service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:56.581018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-c49abbe4-7e53-4d80-9e27-751d00495d8b req-3ff7c7e5-568f-4b21-a6c1-e849bf88f1ec service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:56.601474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-c49abbe4-7e53-4d80-9e27-751d00495d8b req-3ff7c7e5-568f-4b21-a6c1-e849bf88f1ec service nova] Creating event network-vif-unplugged:2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca for instance 36c76af8-35e8-4dbe-885d-cb5510af2411 on hv-cinder-85265 Aug 18 20:58:56.601474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-c49abbe4-7e53-4d80-9e27-751d00495d8b req-3ff7c7e5-568f-4b21-a6c1-e849bf88f1ec service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030391 Aug 18 20:58:56.601474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 276/560] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:58:56.642925 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:56.651311 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b80d6f6c-143c-45be-904f-bc144061ce33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.161143 Aug 18 20:58:56.652180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 285/561] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:56 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:57.550253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:57.551640 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:57.558899 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:57.559408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:57.559845 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:57.560558 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:57.561012 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:57.561440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:57.581572 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:57.673569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:57.674437 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:57.680874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:57.681364 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:57.682307 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:57.683017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:57.683484 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:57.683909 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:57.701304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:57.709528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:57.714240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:57.714240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b2603d24-4db6-4d41-aeb1-e3c9654aa58f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1725 microversion: 2.20 time: 0.166225 Aug 18 20:58:57.714240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 277/562] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:57 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:58:57.734259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c82f0097-f664-44d9-bd43-5651ef5ab839"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:57.736608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:57.742499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:57.742985 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:57.743455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:57.744688 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:57.745146 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:57.745573 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:57.816475 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:57.825172 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0dbe21d1-0809-4ef6-a69e-271994e5db9d tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.155447 Aug 18 20:58:57.825731 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 286/563] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:57 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:58.846850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:58.847495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:58.853788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:58.854310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:58.854710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:58.855417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:58.855870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:58.856296 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:58.882789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6990cf84-4789-493a-94f5-70891e0e6de5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.152384 Aug 18 20:58:58.883517 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 278/564] 10.222.0.62 () {62 vars in 1364 bytes} [Thu Aug 18 20:58:57 2022] POST /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments => generated 188 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 20:58:58.991790 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:59.001040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-827cb399-2931-4f24-8d1c-2181b1c59bfd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.158260 Aug 18 20:58:59.001596 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 287/565] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:58:58 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 20:58:59.010248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:58:59.010844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:59.018450 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:59.018934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:59.019387 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:59.020093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:59.020549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:59.020974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:59.105622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127937) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 20:58:59.455671 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-651ef9f4-600a-46c8-be88-e4e124234e30 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/action" status: 202 len: 0 microversion: 2.20 time: 0.452133 Aug 18 20:58:59.456609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 279/566] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Aug 18 20:58:59 2022] POST /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 20:58:59.466043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:58:59.466916 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:58:59.475256 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:59.478210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:59.478662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:59.479388 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:58:59.479852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:58:59.480461 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:58:59.616889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:59.625917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:59.627434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:58:59.628579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-66b23c21-9b26-4c5f-98c7-ed702a6d5d95 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1751 microversion: 2.20 time: 0.167169 Aug 18 20:58:59.629126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 288/567] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:58:59 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:59:00.022604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:00.023221 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:00.029519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:00.030014 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:00.030456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:00.031153 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:00.031644 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:00.032069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:00.164877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:00.179495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-56f90ac6-9150-4d3e-9b1d-4f38f2291f7e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.161186 Aug 18 20:59:00.180241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 280/568] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:00 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:00.652244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:00.653393 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:00.659807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:00.660334 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:00.660755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:00.661454 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:00.661905 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:00.662361 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:00.796386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:00.805251 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:00.806844 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:00.808120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e9441fd5-df49-4c1c-ac4a-46da27d5deae tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1751 microversion: 2.20 time: 0.160085 Aug 18 20:59:00.808680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 289/569] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:00 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:01.202033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:01.202582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:01.209199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:01.209695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:01.210129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:01.210830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:01.211284 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:01.211736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:01.344386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:01.353289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2c25e795-3aae-492b-abc9-b7a06a916dff tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.155549 Aug 18 20:59:01.353860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 281/570] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:01 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:01.831318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:01.831937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:01.838264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:01.838859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:01.839289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:01.839996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:01.840439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:01.840856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:01.845466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:01.974445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:01.984113 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:01.986571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:01.986944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b15ef576-8aff-4c0b-8d52-6aab5eba905e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1753 microversion: 2.20 time: 0.159394 Aug 18 20:59:01.988196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 290/571] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:01 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:02.374802 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:02.375313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:02.381883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:02.382369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:02.382809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:02.383579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:02.384034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:02.384457 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:02.541100 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:02.549631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-563f2501-6eb4-4694-ad00-a5d104e21f0f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.179441 Aug 18 20:59:02.550223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 282/572] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:02 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:03.010758 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:03.011443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:03.018480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:03.018966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:03.019434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:03.020166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:03.020631 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:03.021061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:03.244520 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:03.254015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:03.255530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:03.256688 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9005d206-f1fb-4d71-a994-671a9796990c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.250152 Aug 18 20:59:03.257241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 291/573] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:03 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:03.572434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:03.573025 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:03.579485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:03.579960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:03.580389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:03.581105 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:03.581602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:03.581974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:03.712121 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:03.720770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-53db3155-d96c-42db-a361-b996968d0f33 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.153417 Aug 18 20:59:03.721448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 283/574] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:03 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:04.279491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:04.280128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:04.286564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:04.287043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:04.287505 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:04.288201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:04.288658 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:04.289105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:04.428495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:04.437853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:04.439348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:04.440512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dc343102-2366-4add-8e43-2e1b5d6047c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.165355 Aug 18 20:59:04.441074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 292/575] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:04 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:04.745772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:04.745772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:04.749500 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:04.749986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:04.750422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:04.751112 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:04.751598 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:04.752026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:04.880804 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:04.889500 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7b049694-ffd1-4b88-8501-ffafa037f6a3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.150699 Aug 18 20:59:04.890094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 284/576] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:04 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:05.463674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:05.464309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:05.470753 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:05.471268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:05.471775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:05.472468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:05.472921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:05.473374 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:05.604513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:05.613852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:05.615378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:05.616612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6b84b456-f520-4c82-ac70-1522e8b34fa0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.156970 Aug 18 20:59:05.617195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 293/577] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:05 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:05.910249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:05.910863 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:05.917700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:05.918195 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:05.918632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:05.920026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:05.920486 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:05.920920 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:06.048389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:06.056475 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a0985158-b36c-4cb7-bfb8-5ae9a3d8f222 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.150017 Aug 18 20:59:06.057040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 285/578] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:05 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:06.641234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:06.641769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:06.648264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:06.648744 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:06.649180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:06.649870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:06.650323 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:06.650747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:06.809047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:06.819452 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:06.821716 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:06.823509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c8683428-0eed-4d15-b903-053742156980 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.186817 Aug 18 20:59:06.824788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 294/579] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:06 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:07.078535 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:07.079138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:07.085699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:07.086175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:07.086606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:07.087379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:07.087829 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:07.088245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:07.232416 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:07.242364 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fa565400-addf-4086-98ab-1910806f84f6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.168024 Aug 18 20:59:07.243982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 286/580] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:07 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:07.847846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:07.848553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:07.854859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:07.855339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:07.855963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:07.856554 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:07.856996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:07.857929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:07.996175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:08.005378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:08.006857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:08.008051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-610366cf-9ddf-4c2f-8f28-699f1e1f502c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.164459 Aug 18 20:59:08.008626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 295/581] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:07 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:08.264347 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:08.264990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:08.271646 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:08.272132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:08.272563 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:08.273263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:08.273715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:08.274142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:08.410227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:08.419211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8a02ccb5-fba7-40f9-940b-809428a16321 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.158563 Aug 18 20:59:08.420359 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 287/582] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:08 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:09.031026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:09.031659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:09.037990 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:09.038467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:09.038898 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:09.039618 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:09.040051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:09.040467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:09.175630 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:09.185007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:09.186521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:09.187744 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-360a96d7-a29b-4bdb-b6ae-bb01a885f9fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.161464 Aug 18 20:59:09.188304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 296/583] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:09 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:09.441397 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:09.442116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:09.448809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:09.449547 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:09.450110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:09.451291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:09.452381 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:09.452858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:09.595268 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:09.606028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3f827f77-7ff9-446b-a23a-2c5c5bc429ec tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.168470 Aug 18 20:59:09.615125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 288/584] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:09 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:10.211775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:10.212437 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:10.219634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:10.220116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:10.220550 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:10.221239 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:10.221684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:10.222100 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:10.362470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:10.371630 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:10.373135 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:10.374319 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e262a195-0f0b-4f92-98ff-22e4a9e1013e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.166465 Aug 18 20:59:10.374872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 297/585] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:10 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:10.632612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:10.633956 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:10.641499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:10.642294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:10.642942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:10.643677 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:10.644136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:10.644568 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:10.785115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:10.795421 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-05de7894-0ea0-45be-8857-66cb39413b83 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.165383 Aug 18 20:59:10.803534 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 289/586] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:10 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:11.398084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:11.399041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:11.407132 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:11.407974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:11.410382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:11.411342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:11.411836 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:11.412274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:11.550282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:11.559853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:11.562055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:11.563331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9dd698ed-e0dc-4db1-9129-96052997c702 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.169282 Aug 18 20:59:11.563991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 298/587] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:11 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:59:11.816742 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:11.817415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:11.823944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:11.824443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:11.824884 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:11.825587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:11.826042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:11.826468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:11.846381 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:11.965186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:11.973731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-787fb66d-1106-4c64-b2e7-320583c39717 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.160865 Aug 18 20:59:11.974286 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 290/588] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:11 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:12.586308 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:12.586876 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:12.594017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:12.594463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:12.594901 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:12.595628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:12.596080 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:12.596508 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:12.738458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:12.747292 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:12.749455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:12.750524 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-50d21d26-9d3e-48e2-94f8-e956a2c0b911 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.168192 Aug 18 20:59:12.751076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 299/589] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:12 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:12.995693 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:12.996936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:13.004394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:13.004882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:13.005310 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:13.006005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:13.006451 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:13.006869 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:13.145110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:13.153968 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9138a9d7-c2cd-44d8-9bc9-f3430858d16a tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.162578 Aug 18 20:59:13.155244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 291/590] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:12 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:13.774026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:13.774637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:13.782265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:13.782759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:13.783196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:13.784046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:13.784507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:13.784926 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:13.926001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:13.935269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:13.936788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:13.938521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bf36eb39-b101-4d2a-81bf-a1b831b27d23 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.168513 Aug 18 20:59:13.939083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 300/591] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:13 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:14.176290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:14.176857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:14.183222 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:14.183745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:14.184182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:14.184876 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:14.185332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:14.185757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:14.321220 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:14.329508 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-59f5cec6-c130-4305-869a-0619c7b439d8 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.157134 Aug 18 20:59:14.330085 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 292/592] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:14 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:14.962027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:14.962704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:14.969117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:14.969586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:14.970015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:14.970691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:14.971133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:14.971575 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:15.133961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:15.143301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:15.144821 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:15.145974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2786c8f1-76bb-4c87-b4b1-7880e4fd2bd4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.187995 Aug 18 20:59:15.146521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 301/593] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:14 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:15.350932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:15.352495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:15.358478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:15.358982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:15.359427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:15.360132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:15.360582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:15.361005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:15.501432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:15.510140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-55855b15-b3c9-4f7a-a29b-c4d845474ad1 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.163380 Aug 18 20:59:15.510722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 293/594] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:15 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:16.169482 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:16.170071 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:16.177137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:16.177619 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:16.178056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:16.178746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:16.179205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:16.179660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:16.318232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:16.327386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:16.329312 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:16.330719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b9c9d768-bad8-4764-8f30-34621b2a96f9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.165233 Aug 18 20:59:16.345193 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 302/595] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:16 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:16.532995 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:16.533614 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:16.540593 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:16.541071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:16.541499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:16.542192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:16.542637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:16.543052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:16.676714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:16.685605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8671b153-6731-43db-b3ad-036e9df40f81 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.157094 Aug 18 20:59:16.686298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 294/596] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:16 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:17.356094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:17.356783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:17.364335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:17.364853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:17.365285 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:17.365976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:17.366423 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:17.366845 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:17.503536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:17.512581 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:17.515425 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:17.516849 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8851a8b9-9999-4c1a-aada-88b93501ddbe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.165304 Aug 18 20:59:17.517753 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 303/597] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:17 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:17.706688 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:17.707346 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:17.713710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:17.714184 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:17.714616 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:17.715290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:17.715817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:17.716252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:17.859690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:17.869454 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7d87cd30-8b4e-45d5-b2ea-4556fec5ed1f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.167166 Aug 18 20:59:17.870035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 295/598] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:17 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:18.540445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:18.541189 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:18.548446 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:18.548939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:18.549376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:18.550083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:18.550531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:18.550961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:18.686550 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:18.695579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:18.697061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:18.698273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dbdf899d-3abf-44f2-85b3-af3a7563f66a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.161853 Aug 18 20:59:18.698822 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 304/599] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:18 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:18.891953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:18.892584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:18.894885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:18.899567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:18.900046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:18.900481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:18.901164 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:18.901628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:18.902032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:19.230652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:19.238965 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-38a1d4c2-d0ed-4f70-9586-720f63c4dddd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.351473 Aug 18 20:59:19.239558 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 296/600] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:18 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:19.721535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:19.722075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:19.728466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:19.728950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:19.729388 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:19.730111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:19.730562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:19.730987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:19.859854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:19.868620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:19.870098 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:19.871265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f185efe3-6a90-4aed-a8e5-d61e1b1bdc59 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.153728 Aug 18 20:59:19.871872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 305/601] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:19 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:20.261257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:20.261919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:20.268417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:20.268895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:20.269332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:20.270027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:20.270567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:20.271115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:20.399848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:20.408922 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2a358943-feaa-4409-9c71-fdeca7a6a9a4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.152066 Aug 18 20:59:20.409477 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 297/602] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:20 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:20.894371 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:20.895191 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:20.901447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:20.902079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:20.902788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:20.903501 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:20.903949 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:20.904373 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:21.036095 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:21.039503 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:21.044917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:21.046408 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:21.047679 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a0fb558a-c4e5-49e2-b1a6-e60d88193974 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.157341 Aug 18 20:59:21.048607 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 306/603] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:20 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:59:21.430029 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:21.430627 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:21.437057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:21.437532 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:21.438577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:21.439257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:21.439729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:21.440153 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:21.572336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:21.581201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b4bb8ee4-b67a-4439-b329-c2865ecec84f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.154996 Aug 18 20:59:21.581761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 298/604] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:21 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:22.069950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:22.070590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:22.077513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:22.077997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:22.078435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:22.079173 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:22.079660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:22.080090 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:22.212805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:22.221895 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:22.223417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:22.224568 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9924f7fd-775f-4bc6-bd65-91745c0d52b9 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.158590 Aug 18 20:59:22.225120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 307/605] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:22 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:22.601602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:22.602199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:22.608708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:22.609136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:22.610090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:22.610782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:22.611235 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:22.611691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:22.753779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:22.763230 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fa967836-9533-4abb-b0d5-d7e0c04187e3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1737 microversion: 2.1 time: 0.165348 Aug 18 20:59:22.763845 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 299/606] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:22 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:23.248230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:23.248832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:23.255181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:23.256996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:23.256996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:23.256996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:23.257284 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:23.257678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:23.399611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:23.411221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:23.414037 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:23.415475 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7c4a0695-047c-4394-8726-5db4f9b629da tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.170955 Aug 18 20:59:23.416190 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 308/607] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:23 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:23.785239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:23.785845 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:23.792337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:23.792820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:23.793262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:23.793956 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:23.794412 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:23.794839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:23.924230 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:23.932306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6717fd04-4f44-4a1b-913e-1e3dab5fa41e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1717 microversion: 2.1 time: 0.151609 Aug 18 20:59:23.932869 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 300/608] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:23 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:23.992294 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:23.992789 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:23.998720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:23.999195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:23.999657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.000342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:24.000857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:24.001279 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.124872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] HTTP exception thrown: Cannot 'detach_volume' instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 while it is in vm_state rescued Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Request method failure captured: Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments/2a4cb13e-cc58-444f-8eea-50c57be2a1d5 HTTP/1.1 Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbG5VsOMS_bHA47YGbs9T8iiAhJ7sT72ojAQ8H0kbJOh8ksbD2jEeQpei16A7FR5Po6xX7fVc4ubiig8qP_kQqbckUucJP-7z1dPwV6WWN-o7_JNk8ZkZiDzqX5ys25l5-Zg0LnhCjUh41AMK1mgLVpRad16ov41Q36Msw82ah5tX4 Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:59:24.126480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_119af0f155d0477cbc4a15a054070278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/119af0f155d0477cbc4a15a054070278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 86c2b496a2c04a0094bf30111bf25669 Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 20:59:24.128139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Cannot 'detach_volume' instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 while it is in vm_state rescued Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'server_id': '6f0c74d7-66e9-4538-85d5-b0841ff4bd25', 'id': '2a4cb13e-cc58-444f-8eea-50c57be2a1d5'} Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:59:24.128965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 while it is in vm_state rescued Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 while it is in vm_state rescued Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:24.130470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Returning 409 to user: Cannot 'detach_volume' instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 while it is in vm_state rescued {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:59:24.131795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f59a1ff8-4b03-438f-9d83-6352d18187c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments/2a4cb13e-cc58-444f-8eea-50c57be2a1d5" status: 409 len: 152 microversion: 2.1 time: 0.139558 Aug 18 20:59:24.131795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 309/609] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 20:59:23 2022] DELETE /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments/2a4cb13e-cc58-444f-8eea-50c57be2a1d5 => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 20:59:24.136844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:59:24.137398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:24.143780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:24.144253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:24.144681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.145362 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:24.145837 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:24.146256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.361380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a0b8f20c-b68a-4d57-8c24-8d4388958961 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "POST /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/action" status: 202 len: 0 microversion: 2.1 time: 0.228125 Aug 18 20:59:24.362010 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 301/610] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 20:59:24 2022] POST /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 20:59:24.370486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:24.371732 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:24.373999 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=54 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:24.379232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:24.379745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:24.380185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.380875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:24.381331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:24.381825 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.439170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:24.439903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:24.446368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:24.446898 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:24.447298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.448029 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:24.448485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:24.448913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:24.515211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:24.524147 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-aeb1e7d1-36ee-4463-bb82-d8b0c2dde770 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1725 microversion: 2.1 time: 0.157538 Aug 18 20:59:24.524815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 310/611] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:24 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:24.586410 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:24.595201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:24.596708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:24.597858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7bd75163-d45c-4eda-9239-09afe77421c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.163478 Aug 18 20:59:24.598407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 302/612] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:24 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:59:25.546250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:25.547001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:25.553382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:25.553863 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:25.554289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:25.554977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:25.555445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:25.555862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:25.620860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:25.621391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:25.628459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:25.628944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:25.629373 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:25.630075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:25.630562 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:25.631174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:25.763807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:25.773289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:25.774840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:25.776088 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-818271a6-3b4b-4d89-8de6-cec6f1edab1a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.159292 Aug 18 20:59:25.776644 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 303/613] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:25 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:59:26.097384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:26.106050 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-90efb849-2d90-4776-a670-cd861c221d9c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1725 microversion: 2.1 time: 0.564288 Aug 18 20:59:26.106627 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 311/614] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:25 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1725 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:26.799945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:26.800542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:26.806969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:26.807483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:26.807917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:26.808603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:26.809053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:26.809475 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:26.939643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:26.948423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:26.949912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:26.951068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-65d8a4be-cc04-4f97-ba37-97779e7755b4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.155640 Aug 18 20:59:26.951663 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 304/615] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:26 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:27.127249 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:27.127889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:27.134424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:27.134912 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:27.135354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:27.136079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:27.136534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:27.136962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:27.268400 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:27.276648 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2ffe1057-633a-40b6-90d8-09898598b15f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1725 microversion: 2.1 time: 0.153291 Aug 18 20:59:27.282657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 312/616] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:27 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:27.974429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:27.975047 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:27.981536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:27.982017 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:27.982455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:27.983152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:27.983634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:27.984063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:28.112611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:28.121582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:28.123062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:28.124327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-79823406-bdaa-421f-b11e-559f76a45f98 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.153895 Aug 18 20:59:28.124930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 305/617] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:27 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:59:28.298154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:28.298835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:28.305203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:28.305680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:28.306112 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:28.306799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:28.307248 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:28.307700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:28.441844 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:28.449447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-78b0f92d-ef74-4f12-b4c1-f70dead3b333 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1725 microversion: 2.1 time: 0.155145 Aug 18 20:59:28.450000 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 313/618] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:28 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:29.148632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:29.149243 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:29.156203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:29.156690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:29.157154 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:29.157853 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:29.158310 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:29.158733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:29.162980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:29.298859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:29.307695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:29.310432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:29.311854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8a40c50c-f2ba-4479-acad-1ef31026a376 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.166865 Aug 18 20:59:29.312846 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 306/619] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:29 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:29.472791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:29.473404 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:29.479348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:29.483817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:29.483817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:29.483817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:29.483817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:29.484212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:29.617131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:29.626819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b44ceebd-a9bd-4c9c-9d26-c54f9210e513 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1725 microversion: 2.1 time: 0.158889 Aug 18 20:59:29.627420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 314/620] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:29 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:30.336364 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:30.337071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:30.343898 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:30.344466 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:30.345409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:30.346124 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:30.346572 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:30.346997 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:30.477145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:30.485946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:30.487467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:30.488618 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-08ec3028-0f01-4d70-a6df-a442be57594f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.156213 Aug 18 20:59:30.489172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 307/621] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:30 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:30.651723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:30.652327 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:30.658956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:30.659456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:30.659886 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:30.660561 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:30.661006 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:30.661424 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:30.789438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:30.797671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-37f5316a-056f-4b5c-9871-6a217094e8f2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1731 microversion: 2.1 time: 0.149849 Aug 18 20:59:30.798740 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 315/622] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:30 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:30.819108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:30.819638 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:30.825670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:30.826147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:30.826581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:30.827273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:30.827751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:30.828177 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:30.904458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-521c3eab-0c6c-4f31-8975-0bdd4934e0c3 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089211 Aug 18 20:59:30.905056 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 308/623] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 20:59:30 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:59:31.512097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:31.512708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:31.518672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:31.519162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:31.519633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:31.520358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:31.520803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:31.521232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:31.656516 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:31.666433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:31.667971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:31.669124 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2d5e67bd-e052-49de-b624-14787942d670 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.161032 Aug 18 20:59:31.669670 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 316/624] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:31 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:31.908731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-0e6762d4-b14f-428c-8b8e-fef2f08e1b48 req-1c75bf60-ba95-4859-bf1c-440c43d965f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0c74d7-66e9-4538-85d5-b0841ff4bd25", "tag": "94bc5780-2e28-429c-9fa9-60743d75ef5f"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:59:31.918133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0e6762d4-b14f-428c-8b8e-fef2f08e1b48 req-1c75bf60-ba95-4859-bf1c-440c43d965f7 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:31.918724 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0e6762d4-b14f-428c-8b8e-fef2f08e1b48 req-1c75bf60-ba95-4859-bf1c-440c43d965f7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:31.919212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-0e6762d4-b14f-428c-8b8e-fef2f08e1b48 req-1c75bf60-ba95-4859-bf1c-440c43d965f7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:31.934257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-0e6762d4-b14f-428c-8b8e-fef2f08e1b48 req-1c75bf60-ba95-4859-bf1c-440c43d965f7 service nova] Creating event network-changed:94bc5780-2e28-429c-9fa9-60743d75ef5f for instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 on hv-cinder-85265 Aug 18 20:59:31.939265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-0e6762d4-b14f-428c-8b8e-fef2f08e1b48 req-1c75bf60-ba95-4859-bf1c-440c43d965f7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098275 Aug 18 20:59:31.939908 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 309/625] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:59:32.694185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:32.695544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:32.702655 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:32.703472 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:32.703924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:32.705295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:32.705817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:32.706634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:32.872347 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:32.881824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:32.883354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:32.884837 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-01ec19b7-1c08-4a52-a9bc-b80962f95d1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.194628 Aug 18 20:59:32.885108 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 317/626] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:32 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:33.909067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:33.909767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:33.915917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:33.916403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:33.916833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:33.917521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:33.917975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:33.918401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:33.953708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-3a9acc5d-afa0-47ab-8db0-52546586bcd9 req-6e5bc702-99d2-4c20-9685-ca6591ef7b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f0c74d7-66e9-4538-85d5-b0841ff4bd25", "tag": "94bc5780-2e28-429c-9fa9-60743d75ef5f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:59:33.963723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3a9acc5d-afa0-47ab-8db0-52546586bcd9 req-6e5bc702-99d2-4c20-9685-ca6591ef7b2e service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:33.964194 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3a9acc5d-afa0-47ab-8db0-52546586bcd9 req-6e5bc702-99d2-4c20-9685-ca6591ef7b2e service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:33.964617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3a9acc5d-afa0-47ab-8db0-52546586bcd9 req-6e5bc702-99d2-4c20-9685-ca6591ef7b2e service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:33.975734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-3a9acc5d-afa0-47ab-8db0-52546586bcd9 req-6e5bc702-99d2-4c20-9685-ca6591ef7b2e service nova] Creating event network-changed:94bc5780-2e28-429c-9fa9-60743d75ef5f for instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 on hv-cinder-85265 Aug 18 20:59:33.980749 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-3a9acc5d-afa0-47ab-8db0-52546586bcd9 req-6e5bc702-99d2-4c20-9685-ca6591ef7b2e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030599 Aug 18 20:59:33.981330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 318/627] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:59:34.052861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:34.061642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:34.063148 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:34.065092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2550a7ed-6934-4362-81bb-e5363228b2cb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.160798 Aug 18 20:59:34.065650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 310/628] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:33 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:35.088912 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:35.089601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:35.096308 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:35.096807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:35.097311 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:35.097997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:35.098447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:35.098873 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:35.236815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:35.245586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:35.247084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:35.248290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4a0d6a04-e4e2-4063-bceb-99dbc2944a75 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.164119 Aug 18 20:59:35.248853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 319/629] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:35 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:36.271640 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:36.272256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:36.279001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:36.279521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:36.279959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:36.280655 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:36.281107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:36.281550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:36.414404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:36.423014 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:36.424540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:36.425690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4fb4dc7d-c9e3-4138-8f52-4e71336a08a6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.157955 Aug 18 20:59:36.426236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 311/630] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:36 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:36.834506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-95adf3fa-cfe5-40db-ac69-81c050827a3d req-e9dd3420-ab31-4c3e-bd7c-ed74fe017ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c76af8-35e8-4dbe-885d-cb5510af2411", "name": "network-vif-plugged", "status": "completed", "tag": "2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:59:36.843812 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-95adf3fa-cfe5-40db-ac69-81c050827a3d req-e9dd3420-ab31-4c3e-bd7c-ed74fe017ec1 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:36.844280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-95adf3fa-cfe5-40db-ac69-81c050827a3d req-e9dd3420-ab31-4c3e-bd7c-ed74fe017ec1 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:36.844707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-95adf3fa-cfe5-40db-ac69-81c050827a3d req-e9dd3420-ab31-4c3e-bd7c-ed74fe017ec1 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:36.855657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-95adf3fa-cfe5-40db-ac69-81c050827a3d req-e9dd3420-ab31-4c3e-bd7c-ed74fe017ec1 service nova] Creating event network-vif-plugged:2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca for instance 36c76af8-35e8-4dbe-885d-cb5510af2411 on hv-cinder-85265 Aug 18 20:59:36.861027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-95adf3fa-cfe5-40db-ac69-81c050827a3d req-e9dd3420-ab31-4c3e-bd7c-ed74fe017ec1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085038 Aug 18 20:59:36.861649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 320/631] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:59:37.449947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:37.451661 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:37.459189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:37.460141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:37.460141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:37.460867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:37.461509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:37.461937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:37.598037 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:37.607313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:37.608789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:37.610001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-128f1e91-816d-4a07-9088-5de5386fd9a4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.165103 Aug 18 20:59:37.610721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 312/632] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:37 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:38.634702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:38.635310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:38.641378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:38.641859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:38.642291 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:38.642973 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:38.643443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:38.643869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:38.776557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:38.785935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:38.787560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:38.788745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7e5601ae-7399-463f-b335-02d089f8e754 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.159060 Aug 18 20:59:38.789302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 321/633] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:38 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:39.813091 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:39.813914 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:39.821812 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:39.822298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:39.822731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:39.823579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:39.824038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:39.824463 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:39.952166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:39.960806 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:39.962305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:39.963499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-500c0330-070a-48c3-8e46-804aab8d1f20 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1809 microversion: 2.20 time: 0.154477 Aug 18 20:59:39.964086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 313/634] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:39 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 20:59:40.986099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:40.986702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:40.993174 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:40.993654 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:40.994091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:40.994782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:40.995238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:40.995688 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:41.123874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:41.132991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:41.134490 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:41.135693 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5376e680-1f85-4173-a178-6fef297139fe tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1796 microversion: 2.20 time: 0.153450 Aug 18 20:59:41.136250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 322/635] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 20:59:40 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 20:59:49.034369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:59:49.036630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:49.039198 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=36 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:49.043859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:49.044330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:49.044764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:49.045448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:49.045897 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:49.046318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:49.282070 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5a167403-086a-4399-a982-8976aa54c00f tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/action" status: 202 len: 0 microversion: 2.1 time: 0.251348 Aug 18 20:59:49.282722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 314/636] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 20:59:49 2022] POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 20:59:49.303828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:49.303828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:49.303828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:49.303828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:49.304865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:49.304865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:49.304865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:49.304865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:49.480094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:49.489322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-00125f5b-eb1d-49bd-8782-fad5c54c7718 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1750 microversion: 2.1 time: 0.202281 Aug 18 20:59:49.503425 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 323/637] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:49 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1750 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:50.512179 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:50.512900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:50.520173 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:50.521370 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:50.521817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:50.522542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:50.523000 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:50.523453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:50.671557 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:50.680462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e1816647-6bcf-4d9f-9a1c-848ae33eedb4 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.173201 Aug 18 20:59:50.680953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 315/638] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:50 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:51.701891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:51.702438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:51.708860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:51.709345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:51.709780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:51.710474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:51.710938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:51.711354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:51.851939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:51.855516 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:51.860479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-00abadad-7f15-4573-8848-70f55c520f04 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.162860 Aug 18 20:59:51.861042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 324/639] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:51 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:52.882407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:52.883603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:52.890085 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:52.890566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:52.890992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:52.891703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:52.892148 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:52.892564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:53.036084 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:53.044443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8320ff61-c49c-4ca5-bf08-ac16d9e02985 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.166437 Aug 18 20:59:53.045005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 316/640] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:52 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:54.065815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:54.066456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:54.074483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.074970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.075440 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.076167 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.076624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.077075 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.205835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:54.206379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:54.213297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.213865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.214368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.215159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.215640 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.216070 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.225539 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:54.233921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1a91ddfe-2784-4ade-9992-7e5f745d228d tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.172423 Aug 18 20:59:54.240252 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 325/641] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:54 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:54.240481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-277a6511-1f44-455c-ae1a-5f9a8d92af5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015/ips" status: 200 len: 151 microversion: 2.1 time: 0.091574 Aug 18 20:59:54.240481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 317/642] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 20:59:54 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 20:59:54.251339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:59:54.253707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:54.260400 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.260881 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.261312 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.262076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.262526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.262945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.342730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Invalid volume: volume dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df is already attached to instances: a81738bf-5d23-441d-8b75-e66cf5781acf Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: POST /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015/os-volume_attachments HTTP/1.1 Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 74 Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 20:59:54.344577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {"volumeAttachment": {"volumeId": "dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df"}} Aug 18 20:59:54.345963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Invalid volume: volume dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df is already attached to instances: a81738bf-5d23-441d-8b75-e66cf5781acf Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'server_id': '18708cef-6c64-4887-a36e-5772b2174015', 'body': {'volumeAttachment': {'volumeId': 'dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df'}}} Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df is already attached to instances: a81738bf-5d23-441d-8b75-e66cf5781acf Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:54.346771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df is already attached to instances: a81738bf-5d23-441d-8b75-e66cf5781acf Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:54.348093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df is already attached to instances: a81738bf-5d23-441d-8b75-e66cf5781acf Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 400 to user: Invalid volume: volume dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df is already attached to instances: a81738bf-5d23-441d-8b75-e66cf5781acf {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-81527402-06c6-426f-be61-e82f80688b99 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098717 Aug 18 20:59:54.349309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 326/643] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 20:59:54 2022] POST /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 20:59:54.355518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:54.356052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:54.362040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.362525 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.362975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.363686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.364143 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.364579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.389952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Going to try to terminate instance {{(pid=127937) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 20:59:54.768939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9ff39544-6d57-4e8f-933b-27aba63e46ba tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 204 len: 0 microversion: 2.1 time: 0.417226 Aug 18 20:59:54.769531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 318/644] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 20:59:54 2022] DELETE /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 20:59:54.777667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:54.778875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:54.780381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=34 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:54.785827 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.786319 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.786763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.787512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:54.787953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:54.788385 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:54.918597 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:54.926315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4c7284bd-81b1-4cfa-a4f3-58c627185dca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1681 microversion: 2.1 time: 0.152422 Aug 18 20:59:54.926866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 327/645] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:54 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:55.255821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:55.256515 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:55.263474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:55.263959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:55.264403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:55.265090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:55.265548 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:55.265973 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:55.411834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:55.420102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b1dfee2e-efbd-4ce6-895d-2a284f8d0720 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.168559 Aug 18 20:59:55.420667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 319/646] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:55 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:55.948301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:55.948927 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:55.955328 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:55.955840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:55.956275 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:55.956965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:55.957422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:55.957874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:56.088860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:56.096671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-134fc9d9-e5e3-4224-a66e-b7dcae9771dc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1681 microversion: 2.1 time: 0.152207 Aug 18 20:59:56.097235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 328/647] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:55 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:56.441760 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:56.442406 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:56.449504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:56.449990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:56.450430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:56.451135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:56.451699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:56.452126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:56.593506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:56.601862 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-96a57444-c3a1-4410-862b-52c723973b6c tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.163967 Aug 18 20:59:56.602432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 320/648] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:56 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:57.118526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:57.119134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:57.125567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:57.126053 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:57.126486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:57.127181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:57.127660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:57.128085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:57.373940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:57.382141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3fbbf6df-a895-46aa-8096-cbe6295748e6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1681 microversion: 2.1 time: 0.267920 Aug 18 20:59:57.382807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 329/649] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:57 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:57.622821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:57.623301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:57.629780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:57.630265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:57.630709 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:57.631489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:57.631950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:57.632377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:57.650948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:57.780429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:57.789152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-81f92baa-c53f-4a3e-97f9-4060238016f6 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.170244 Aug 18 20:59:57.789725 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 321/650] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:57 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:58.187754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-ba1bb51f-7f58-4ffd-bbf1-c8b1c282a7c2 req-709b8168-495d-400e-aaaf-43a63f6864ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18708cef-6c64-4887-a36e-5772b2174015", "name": "network-vif-deleted", "tag": "f9d700d2-9284-4783-b567-bf781fc17f3a"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 20:59:58.198776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ba1bb51f-7f58-4ffd-bbf1-c8b1c282a7c2 req-709b8168-495d-400e-aaaf-43a63f6864ad service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:58.199453 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ba1bb51f-7f58-4ffd-bbf1-c8b1c282a7c2 req-709b8168-495d-400e-aaaf-43a63f6864ad service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:58.199893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ba1bb51f-7f58-4ffd-bbf1-c8b1c282a7c2 req-709b8168-495d-400e-aaaf-43a63f6864ad service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:58.211760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-ba1bb51f-7f58-4ffd-bbf1-c8b1c282a7c2 req-709b8168-495d-400e-aaaf-43a63f6864ad service nova] Creating event network-vif-deleted:f9d700d2-9284-4783-b567-bf781fc17f3a for instance 18708cef-6c64-4887-a36e-5772b2174015 on hv-cinder-85265 Aug 18 20:59:58.216849 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-ba1bb51f-7f58-4ffd-bbf1-c8b1c282a7c2 req-709b8168-495d-400e-aaaf-43a63f6864ad service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091389 Aug 18 20:59:58.217786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 330/651] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 20:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 20:59:58.407628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:58.407628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:58.409959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:58.410434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:58.410865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:58.411585 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:58.412057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:58.412477 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:58.487541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:58.495647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-90852545-ee97-4ecb-b68d-eee2dd7b4df6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 200 len: 1325 microversion: 2.1 time: 0.097347 Aug 18 20:59:58.496401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 322/652] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:58 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:58.811273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:58.812041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:58.818323 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:58.818813 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:58.819310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:58.820369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:58.821034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:58.821487 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:58.978178 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 20:59:58.987401 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d5176378-b9ab-4393-9a99-ec4394e9c1b7 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.180260 Aug 18 20:59:58.988180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 331/653] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:58 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 20:59:59.515984 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:59.516604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 20:59:59.523914 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:59.524460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:59.524897 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:59.525595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 20:59:59.526086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 20:59:59.526541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 20:59:59.542974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 HTTP/1.1 Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 20:59:59.545259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 20:59:59.546783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '18708cef-6c64-4887-a36e-5772b2174015'} Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 20:59:59.547607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 20:59:59.549219 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 20:59:59.550821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 20:59:59.550821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b6cf46e2-69f8-4c83-b0fc-276c23528cd4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 404 len: 111 microversion: 2.1 time: 0.034814 Aug 18 20:59:59.550821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 323/654] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 20:59:59 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 20:59:59.556130 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-38274833-666f-4fc7-aeb3-997b021f4510 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '.version_select at 0x7f8b5a330790>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 20:59:59.644253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-38274833-666f-4fc7-aeb3-997b021f4510 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240110198" status: 202 len: 0 microversion: 2.1 time: 0.091671 Aug 18 20:59:59.645012 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 332/655] 10.222.0.62 () {58 vars in 1218 bytes} [Thu Aug 18 20:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240110198 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:00:00.010107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:00.010885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:00.021643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:00.022145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:00.022579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:00.023318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:00.023802 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:00.024227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:00.264366 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:00.272834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5cfb146c-2d12-4961-83aa-ae44a91f651b tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.267546 Aug 18 21:00:00.273576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 324/656] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:00 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:00.561066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:00.561582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:00.568484 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:00.568962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:00.569392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:00.570073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:00.570624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:00.571049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:00.654616 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lazy-loading 'services' on Instance uuid a81738bf-5d23-441d-8b75-e66cf5781acf {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:00:00.928433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7a3fd55c-0bfd-45a6-8019-7f00ae8a3af2 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments/dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df" status: 202 len: 0 microversion: 2.1 time: 0.371047 Aug 18 21:00:00.928918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 333/657] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:00:00 2022] DELETE /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments/dd88a1d8-bd2f-4632-b585-0aa8ce3ac3df => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:00:00.938351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:00.940707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:00.948262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:00.950138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:00.950138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:00.950138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:00.950447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:00.950803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:00.981023 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3c86b8df-0035-4dcd-b770-f068d2a6c005 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046807 Aug 18 21:00:00.983064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 325/658] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:00:00 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:01.295435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:01.296137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:01.302402 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:01.302889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:01.303327 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:01.304042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:01.304523 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:01.304954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:01.452852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:01.461860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9d4f7b38-7992-4549-ae5a-07b499944ccc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.170141 Aug 18 21:00:01.462438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 334/659] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:01 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:01.994697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:01.996958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:02.003348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:02.003876 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:02.004393 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:02.005093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:02.005545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:02.006011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:02.034827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2065a3c2-6c05-4fc5-a75f-84fbc890080e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Aug 18 21:00:02.035398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 326/660] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:00:01 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:00:02.482498 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:02.483038 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:02.489534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:02.490018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:02.490460 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:02.491147 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:02.491625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:02.492054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:02.634074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:02.642310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8bfbfc63-ec43-4310-bfb7-841d62125894 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.163735 Aug 18 21:00:02.642871 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 335/661] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:02 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:03.047055 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:03.049242 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:03.056228 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.056735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.057173 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.057865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.058319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.058744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.088588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-52e6d00a-9ca2-4a4b-825b-0e8692159015 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045428 Aug 18 21:00:03.089145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 327/662] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:00:03 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:00:03.151293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:03.151815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:03.157906 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.158394 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.158828 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.159547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.160002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.160432 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.185685 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:00:03.478011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c41ff9ff-e038-4e5c-9f52-ec212913a60a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 204 len: 0 microversion: 2.1 time: 0.330715 Aug 18 21:00:03.478794 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 336/663] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:00:03 2022] DELETE /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:03.487115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:03.487771 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:03.493787 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.494267 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.494703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.495409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.495859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.496281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.623715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:03.631339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2dfebcb0-4926-45a7-80d1-662c9dc1c394 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1679 microversion: 2.1 time: 0.148111 Aug 18 21:00:03.631917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 328/664] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:03 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:03.663212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:03.663945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:03.670527 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.671011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.671486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.672177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:03.672634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:03.673059 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:03.819324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:03.828467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7a3d4059-c635-4bf7-ba0d-d072844347b5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.169368 Aug 18 21:00:03.829040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 337/665] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:03 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:04.653447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:04.654311 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:04.660279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:04.660772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:04.661210 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:04.661909 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:04.662369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:04.662796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:04.795878 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:04.803580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a795a040-e0e9-4b37-a6f5-6015c4a30dab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1679 microversion: 2.1 time: 0.154592 Aug 18 21:00:04.804142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 329/666] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:04 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:04.849191 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:04.849805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:04.856787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:04.857272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:04.865021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:04.865021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:04.865021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:04.865021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:05.294401 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:05.303351 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-76d8be34-0403-4afb-a4af-2e9d3ab516a8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.457925 Aug 18 21:00:05.304039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 338/667] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:04 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:05.659650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-fa77e66e-6bc6-49b8-96eb-f3ae6a72eff1 req-bf20c69e-7a53-46d1-8e86-ce61e27f868f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81738bf-5d23-441d-8b75-e66cf5781acf", "name": "network-vif-deleted", "tag": "815b310a-9ed7-4cf5-bc0c-e3c9a87a8824"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:05.672124 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-fa77e66e-6bc6-49b8-96eb-f3ae6a72eff1 req-bf20c69e-7a53-46d1-8e86-ce61e27f868f service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:05.672639 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-fa77e66e-6bc6-49b8-96eb-f3ae6a72eff1 req-bf20c69e-7a53-46d1-8e86-ce61e27f868f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:05.673081 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-fa77e66e-6bc6-49b8-96eb-f3ae6a72eff1 req-bf20c69e-7a53-46d1-8e86-ce61e27f868f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:05.689341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-fa77e66e-6bc6-49b8-96eb-f3ae6a72eff1 req-bf20c69e-7a53-46d1-8e86-ce61e27f868f service nova] Creating event network-vif-deleted:815b310a-9ed7-4cf5-bc0c-e3c9a87a8824 for instance a81738bf-5d23-441d-8b75-e66cf5781acf on hv-cinder-85265 Aug 18 21:00:05.695731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-fa77e66e-6bc6-49b8-96eb-f3ae6a72eff1 req-bf20c69e-7a53-46d1-8e86-ce61e27f868f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038814 Aug 18 21:00:05.695731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 330/668] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:05.829856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:05.831765 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:05.845474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:05.846834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:05.847921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:05.849907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:05.851677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:05.855561 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:05.944624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:05.952510 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6a592001-6a19-4dbf-8b0f-8b2af7c2a927 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 200 len: 1325 microversion: 2.1 time: 0.130534 Aug 18 21:00:05.953076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 339/669] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:05 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 1325 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:06.324526 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:06.325227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:06.331583 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:06.332158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:06.332601 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:06.333312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:06.333764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:06.334190 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:06.502220 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:06.510504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2884c826-64e0-42bc-8be2-e5b00f41959e tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1755 microversion: 2.1 time: 0.190184 Aug 18 21:00:06.511068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 331/670] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:06 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:06.973595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:06.974235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:06.980669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:06.981157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:06.981596 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:06.982363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:06.982788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:06.983212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:06.998150 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf HTTP/1.1 Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:00:07.010417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:00:07.012025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'a81738bf-5d23-441d-8b75-e66cf5781acf'} Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:00:07.012922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:00:07.014436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:00:07.015935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:00:07.015935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d7527ab8-7ce0-4e38-a45e-6dfdc2f87168 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 404 len: 111 microversion: 2.1 time: 0.031505 Aug 18 21:00:07.015935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 340/671] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:06 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:00:07.016191 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-17d6593f-80d7-4fd1-ad30-a17ccbcf23b4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '.version_select at 0x7f8b5a5091f0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:07.016191 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17d6593f-80d7-4fd1-ad30-a17ccbcf23b4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [2313d683-1f12-4dd3-8569-616062fc7da9] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 21:00:07.530991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:07.531628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:07.537538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:07.538013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:07.538442 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:07.539116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:07.539591 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:07.540011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:07.558549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:07.687938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:07.696446 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4e0170f1-98cf-48f6-acf1-cca3166a99c2 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1758 microversion: 2.1 time: 0.169541 Aug 18 21:00:07.697021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 341/672] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:07 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:08.022646 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [None req-17d6593f-80d7-4fd1-ad30-a17ccbcf23b4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [2313d683-1f12-4dd3-8569-616062fc7da9] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 38888. Aug 18 21:00:08.107881 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-17d6593f-80d7-4fd1-ad30-a17ccbcf23b4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-828167663" status: 202 len: 0 microversion: 2.1 time: 1.101527 Aug 18 21:00:08.108597 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 332/673] 10.222.0.62 () {58 vars in 1218 bytes} [Thu Aug 18 21:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-828167663 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:00:08.919466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0e401fe3-57f3-4ddf-8fdb-00fcbe255033 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: .version_select at 0x7f8b5a2cd550>, body: {"keypair": {"name": "tempest-keypair-705666666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOR8TW2gEDJxAI/svMFK6CCXWvSgwbyqzqqlwILKLqMIhJC1TvStpuRY4DwpObwzYF1UBveVa103/byRZXdCWPtWySn2qsha3M32wfcsrGwmCq/4MSCESdDatDi2ASRLrg=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:08.935606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-0e401fe3-57f3-4ddf-8fdb-00fcbe255033 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:00:08.939285 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-0e401fe3-57f3-4ddf-8fdb-00fcbe255033 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:00:09.038849 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0e401fe3-57f3-4ddf-8fdb-00fcbe255033 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123993 Aug 18 21:00:09.039509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 342/674] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 21:00:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:09.110302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:00:09.110468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Thu Aug 18 21:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:00:11.365139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1788538250", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c5039fe-c5ac-448f-a973-5b4f5015467c"}], "security_groups": [{"name": "tempest-securitygroup--66873508"}], "key_name": "tempest-keypair-705666666", "user_data": "}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:11.471036 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] validate_networks() for [('1c5039fe-c5ac-448f-a973-5b4f5015467c', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:00:11.840627 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:00:11.841041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:00:11.841537 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:00:11.841942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:00:11.842347 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:00:11.851007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:11.851501 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:11.852007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:11.852720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:11.853170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:11.853586 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:11.870520 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:00:11.874576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:00:11.885449 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:00:11.887752 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:00:12.045772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3e97cf0d-4361-4d2c-812f-85dce9dacb2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.684819 Aug 18 21:00:12.046608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 333/675] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:00:11 2022] POST /compute/v2.1/servers => generated 400 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:00:12.058011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8efee0d1-ff99-46dd-88cd-033aa56be2c4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:12.058634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8efee0d1-ff99-46dd-88cd-033aa56be2c4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:12.114025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8efee0d1-ff99-46dd-88cd-033aa56be2c4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:12.121798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8efee0d1-ff99-46dd-88cd-033aa56be2c4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1241 microversion: 2.1 time: 0.068218 Aug 18 21:00:12.122372 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 343/676] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:12 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:13.143350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:13.153312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:13.153312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:13.153312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:13.153619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:13.154299 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:13.154756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:13.155202 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:13.423341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:13.431127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a0087fc1-ad37-4f2e-8243-25f8f9d1903d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1245 microversion: 2.1 time: 0.292281 Aug 18 21:00:13.431729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 334/677] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:13 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1245 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:14.452715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:14.454061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:14.461735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:14.462290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:14.462961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:14.463916 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:14.465147 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:14.465773 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:14.570234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:14.578645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4d86a426-ec6d-485f-99dd-8e2453c73e5a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1301 microversion: 2.1 time: 0.130347 Aug 18 21:00:14.579204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 344/678] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:14 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1301 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:15.600160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:15.600898 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:15.607734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:15.608232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:15.608677 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:15.609440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:15.609900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:15.610325 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:15.741338 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:15.750149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8aff2927-4b02-4327-a4ee-f9a64ee85df4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.154468 Aug 18 21:00:15.756262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 335/679] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:15 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:16.003068 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-cb4f0ae0-fe9a-4935-ab87-01a1b89d3c95 req-07c00565-3626-4da8-bd15-a5938c857db7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ec55a1-210c-4113-8e6b-26a08a596519", "tag": "c8f61743-94fb-4639-9208-0b62c215c0cb"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:16.012750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cb4f0ae0-fe9a-4935-ab87-01a1b89d3c95 req-07c00565-3626-4da8-bd15-a5938c857db7 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:16.013206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cb4f0ae0-fe9a-4935-ab87-01a1b89d3c95 req-07c00565-3626-4da8-bd15-a5938c857db7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:16.013634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cb4f0ae0-fe9a-4935-ab87-01a1b89d3c95 req-07c00565-3626-4da8-bd15-a5938c857db7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:16.024476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-cb4f0ae0-fe9a-4935-ab87-01a1b89d3c95 req-07c00565-3626-4da8-bd15-a5938c857db7 service nova] Creating event network-changed:c8f61743-94fb-4639-9208-0b62c215c0cb for instance 64ec55a1-210c-4113-8e6b-26a08a596519 on hv-cinder-85265 Aug 18 21:00:16.029647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-cb4f0ae0-fe9a-4935-ab87-01a1b89d3c95 req-07c00565-3626-4da8-bd15-a5938c857db7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029913 Aug 18 21:00:16.030240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 345/680] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:16.771644 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:16.772297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:16.778676 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:16.779448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:16.779891 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:16.780584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:16.781037 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:16.781462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:16.912314 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:16.920434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-52e55625-8485-4a87-957a-5980008fc12d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.152683 Aug 18 21:00:16.920992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 336/681] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:16 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:17.942067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:17.942761 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:17.948976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:17.949638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:17.950380 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:17.951531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:17.952339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:17.952788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:18.084163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:18.092593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1f87deba-7293-40db-b6fd-b472eb237773 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.155241 Aug 18 21:00:18.093296 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 346/682] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:17 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:19.112798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:19.113411 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:19.115840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:19.120570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:19.121056 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:19.121493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:19.122215 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:19.122664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:19.123089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:19.250170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:19.258024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-91f273fb-28bf-4afb-bb8d-5cb9d444e21d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.149030 Aug 18 21:00:19.258594 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 337/683] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:19 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:20.278194 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:20.279652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:20.286050 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:20.286530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:20.286964 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:20.287682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:20.288133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:20.288558 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:20.418786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:20.426499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b630af96-d8a7-4257-a7db-7dbf673b1e20 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.152173 Aug 18 21:00:20.427064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 347/684] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:20 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:21.446786 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:21.447402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:21.455005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:21.455514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:21.455946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:21.456639 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:21.457105 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:21.457555 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:21.592446 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:21.600290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e209f7db-0688-422c-a8d7-fe90919ce2eb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.157298 Aug 18 21:00:21.601048 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 338/685] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:21 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:22.620123 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:22.620725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:22.623258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=6 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:22.628641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:22.629110 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:22.629537 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:22.630219 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:22.630662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:22.631083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:22.765191 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:22.772991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-631ad15f-f3ca-40e9-92a7-66b01df162aa tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.156740 Aug 18 21:00:22.773560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 348/686] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:22 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:23.296929 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-55a302fe-a71c-4a2f-881e-2683d414fc6c req-c0b7c91d-cfbb-4ac6-85ef-54652752f757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ec55a1-210c-4113-8e6b-26a08a596519", "name": "network-vif-plugged", "status": "completed", "tag": "c8f61743-94fb-4639-9208-0b62c215c0cb"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:23.302174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:23.304991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:23.309203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-55a302fe-a71c-4a2f-881e-2683d414fc6c req-c0b7c91d-cfbb-4ac6-85ef-54652752f757 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:23.309683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-55a302fe-a71c-4a2f-881e-2683d414fc6c req-c0b7c91d-cfbb-4ac6-85ef-54652752f757 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:23.310116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-55a302fe-a71c-4a2f-881e-2683d414fc6c req-c0b7c91d-cfbb-4ac6-85ef-54652752f757 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:23.322604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-55a302fe-a71c-4a2f-881e-2683d414fc6c req-c0b7c91d-cfbb-4ac6-85ef-54652752f757 service nova] Creating event network-vif-plugged:c8f61743-94fb-4639-9208-0b62c215c0cb for instance 64ec55a1-210c-4113-8e6b-26a08a596519 on hv-cinder-85265 Aug 18 21:00:23.327774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-55a302fe-a71c-4a2f-881e-2683d414fc6c req-c0b7c91d-cfbb-4ac6-85ef-54652752f757 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034560 Aug 18 21:00:23.329115 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 339/687] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:23.794157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:23.794766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:23.801204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:23.801736 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:23.802172 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:23.802855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:23.803303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:23.803786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:23.931566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:23.939900 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ca4a3115-81bc-4fb4-bf02-fd5f4736743a tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.149606 Aug 18 21:00:23.940472 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 349/688] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:23 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:24.960700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:24.961394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:24.969006 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:24.969494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:24.970592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:24.971288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:24.971809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:24.972234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:25.103735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:25.111485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d5ac8124-7c3e-43a5-91b1-ff6e19c19fc0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1365 microversion: 2.1 time: 0.154899 Aug 18 21:00:25.112248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 340/689] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:24 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:26.135599 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:26.136212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:26.138473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:26.143200 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:26.143786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:26.144244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:26.144935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:26.145382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:26.145805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:26.278028 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:26.289335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cf08db47-52b6-4421-9438-12f0fc4111ab tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1555 microversion: 2.1 time: 0.157569 Aug 18 21:00:26.294301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 350/690] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:26 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:26.309586 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:26.310087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:26.316492 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:26.316971 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:26.317406 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:26.318097 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:26.318547 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:26.318970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:26.397700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ff24fdf4-2777-47b2-b474-a5ce1c9233c1 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091858 Aug 18 21:00:26.398285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 341/691] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 21:00:26 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:27.408902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-e49fb95d-9e05-47c8-8fd9-034aac5b6a58 req-9632722b-e0f2-43c2-80fa-30c7a120cb76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64ec55a1-210c-4113-8e6b-26a08a596519", "tag": "c8f61743-94fb-4639-9208-0b62c215c0cb"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:27.419014 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e49fb95d-9e05-47c8-8fd9-034aac5b6a58 req-9632722b-e0f2-43c2-80fa-30c7a120cb76 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:27.419757 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e49fb95d-9e05-47c8-8fd9-034aac5b6a58 req-9632722b-e0f2-43c2-80fa-30c7a120cb76 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:27.420189 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e49fb95d-9e05-47c8-8fd9-034aac5b6a58 req-9632722b-e0f2-43c2-80fa-30c7a120cb76 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:27.431800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-e49fb95d-9e05-47c8-8fd9-034aac5b6a58 req-9632722b-e0f2-43c2-80fa-30c7a120cb76 service nova] Creating event network-changed:c8f61743-94fb-4639-9208-0b62c215c0cb for instance 64ec55a1-210c-4113-8e6b-26a08a596519 on hv-cinder-85265 Aug 18 21:00:27.437067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-e49fb95d-9e05-47c8-8fd9-034aac5b6a58 req-9632722b-e0f2-43c2-80fa-30c7a120cb76 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Aug 18 21:00:27.437894 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 351/692] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:38.270697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=9 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:38.271600 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=98 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:38.275474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:38.275974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:38.282108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:38.282589 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:38.283026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:38.283751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:38.284203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:38.284628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:38.410315 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lazy-loading 'services' on Instance uuid 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:00:38.665135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9070a1eb-3ff5-43d4-bd4c-0222b8e901d6 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments/2a4cb13e-cc58-444f-8eea-50c57be2a1d5" status: 202 len: 0 microversion: 2.1 time: 0.396157 Aug 18 21:00:38.665728 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 342/693] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:00:38 2022] DELETE /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments/2a4cb13e-cc58-444f-8eea-50c57be2a1d5 => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:00:38.674582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:38.676938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:38.679605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:38.680318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=42 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:38.685018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:38.685498 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:38.685936 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:38.686669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:38.687120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:38.687570 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:38.717556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a9105bd6-e671-4675-9552-3ab63dfb2995 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047206 Aug 18 21:00:38.719086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 352/694] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:00:38 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:39.731409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:39.733716 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:39.740868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:39.741362 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:39.741805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:39.742509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:39.742962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:39.743415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:39.772808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-741680f8-7ef0-42a8-956d-c27f706624f4 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Aug 18 21:00:39.775245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 343/695] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:00:39 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:40.786892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:40.789045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:40.795996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:40.796486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:40.796924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:40.797616 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:40.798101 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:40.798534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:40.826878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a3bb3bb6-66b0-4cc9-b6d0-4281cc96fef7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045014 Aug 18 21:00:40.827445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 353/696] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:00:40 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:00:40.907403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:40.908561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:40.915789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:40.918401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:40.918401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:40.918401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:40.918401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:40.918783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:40.947445 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Going to try to terminate instance {{(pid=127937) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:00:41.277160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2d353ada-9144-4934-8eb3-60ef3b6b36a2 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 204 len: 0 microversion: 2.1 time: 0.373543 Aug 18 21:00:41.277747 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 344/697] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:00:40 2022] DELETE /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:41.285967 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:41.288270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:41.293078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:41.293565 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:41.294008 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:41.294695 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:41.295150 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:41.295612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:41.426918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:41.434621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-84ea3264-c2fe-40d3-8e61-ca43a057bfa0 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1691 microversion: 2.1 time: 0.152521 Aug 18 21:00:41.435181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 354/698] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:41 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:42.456531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:42.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:42.465203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:42.465699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:42.466127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:42.466826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:42.467273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:42.467733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:42.602892 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:42.610689 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7d7b8e9f-b673-4787-a9a3-d61bdda676fe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1691 microversion: 2.1 time: 0.158345 Aug 18 21:00:42.611241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 345/699] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:42 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:43.631645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:43.632197 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:43.638704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:43.639184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:43.639665 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:43.640364 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:43.640820 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:43.641245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:43.781893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:43.790141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8d8b4187-7874-44cd-ac31-98af2cd39e0e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1691 microversion: 2.1 time: 0.162457 Aug 18 21:00:43.790705 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 355/700] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:43 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:44.810735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:44.811341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:44.817834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:44.818317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:44.818751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:44.819470 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:44.819923 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:44.821227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:44.951031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:44.959311 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-593d14e9-f0ae-4c4a-a6f1-13bc092be8ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1691 microversion: 2.1 time: 0.151872 Aug 18 21:00:44.959919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 346/701] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:44 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:45.980778 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:45.981338 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:45.987500 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:45.987991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:45.988433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:45.989141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:45.989600 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:45.990029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:46.213950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:46.223336 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-35c3f26b-f864-4878-a34f-f37152f8ce4c tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1691 microversion: 2.1 time: 0.246432 Aug 18 21:00:46.224042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 356/702] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:45 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:46.716004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-b61920ed-5763-4060-a8ed-142af3f9f072 req-0cfb3b8e-11dd-4b83-bba4-64dfaa73e12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f0c74d7-66e9-4538-85d5-b0841ff4bd25", "name": "network-vif-deleted", "tag": "94bc5780-2e28-429c-9fa9-60743d75ef5f"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:46.726376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b61920ed-5763-4060-a8ed-142af3f9f072 req-0cfb3b8e-11dd-4b83-bba4-64dfaa73e12d service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:46.726849 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b61920ed-5763-4060-a8ed-142af3f9f072 req-0cfb3b8e-11dd-4b83-bba4-64dfaa73e12d service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:46.727275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b61920ed-5763-4060-a8ed-142af3f9f072 req-0cfb3b8e-11dd-4b83-bba4-64dfaa73e12d service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:46.739326 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-b61920ed-5763-4060-a8ed-142af3f9f072 req-0cfb3b8e-11dd-4b83-bba4-64dfaa73e12d service nova] Creating event network-vif-deleted:94bc5780-2e28-429c-9fa9-60743d75ef5f for instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 on hv-cinder-85265 Aug 18 21:00:46.744633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-b61920ed-5763-4060-a8ed-142af3f9f072 req-0cfb3b8e-11dd-4b83-bba4-64dfaa73e12d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035108 Aug 18 21:00:46.745281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 347/703] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:47.246287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:47.246976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:47.254208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:47.254761 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:47.255268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:47.256231 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:47.256861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:47.257373 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:47.291223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:47.291875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:47.292376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:47.292982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lazy-loading 'fault' on Instance uuid 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:00:47.333889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:47.342200 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1436cd36-3e63-40c0-b69d-acea096142ce tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 200 len: 1336 microversion: 2.1 time: 0.100312 Aug 18 21:00:47.342759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 357/704] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:47 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:48.367242 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:48.367972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 6f0c74d7-66e9-4538-85d5-b0841ff4bd25] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:48.374223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:48.374734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:48.375163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:48.375933 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:48.376347 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:48.376773 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:48.389810 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] HTTP exception thrown: Instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 could not be found. Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Request method failure captured: Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 HTTP/1.1 Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbG5VsOMS_bHA47YGbs9T8iiAhJ7sT72ojAQ8H0kbJOh8ksbD2jEeQpei16A7FR5Po6xX7fVc4ubiig8qP_kQqbckUucJP-7z1dPwV6WWN-o7_JNk8ZkZiDzqX5ys25l5-Zg0LnhCjUh41AMK1mgLVpRad16ov41Q36Msw82ah5tX4 Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:00:48.391422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_119af0f155d0477cbc4a15a054070278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/119af0f155d0477cbc4a15a054070278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 86c2b496a2c04a0094bf30111bf25669 Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 could not be found. Aug 18 21:00:48.393004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '6f0c74d7-66e9-4538-85d5-b0841ff4bd25'} Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 could not be found. Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:00:48.393859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 could not be found. Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 could not be found. Aug 18 21:00:48.395440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:48.396814 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Returning 404 to user: Instance 6f0c74d7-66e9-4538-85d5-b0841ff4bd25 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:00:48.396814 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-342f9908-5c9f-45b8-be5f-6c0c2fdd55b7 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25" status: 404 len: 111 microversion: 2.1 time: 0.030915 Aug 18 21:00:48.396814 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 348/705] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:48 2022] GET /compute/v2.1/servers/6f0c74d7-66e9-4538-85d5-b0841ff4bd25 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:00:48.401510 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d6648e2e-10d9-44a5-a996-4a6cdcbeed82 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '.version_select at 0x7f8b5a339670>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:48.512913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d6648e2e-10d9-44a5-a996-4a6cdcbeed82 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432252144" status: 202 len: 0 microversion: 2.1 time: 0.114918 Aug 18 21:00:48.513736 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 358/706] 10.222.0.62 () {58 vars in 1221 bytes} [Thu Aug 18 21:00:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1432252144 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:00:48.572759 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:48.573267 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:48.579597 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:48.580086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:48.580526 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:48.581234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:48.581686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:48.582114 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:48.612227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3ac23913-4e62-4705-a367-3488db357bcb tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments/c82f0097-f664-44d9-bd43-5651ef5ab839" status: 200 len: 194 microversion: 2.20 time: 0.159229 Aug 18 21:00:48.615791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 349/707] 10.222.0.62 () {60 vars in 1454 bytes} [Thu Aug 18 21:00:48 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments/c82f0097-f664-44d9-bd43-5651ef5ab839 => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:00:48.679434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:48.679932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:48.686017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:48.686507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:48.687078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:48.687677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:48.688139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:48.688565 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:48.769302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lazy-loading 'services' on Instance uuid 36c76af8-35e8-4dbe-885d-cb5510af2411 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:00:49.060114 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-87d1e316-4e36-41d5-83bb-65e19d51fcaa tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments/c82f0097-f664-44d9-bd43-5651ef5ab839" status: 202 len: 0 microversion: 2.20 time: 0.384621 Aug 18 21:00:49.060733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 359/708] 10.222.0.62 () {60 vars in 1457 bytes} [Thu Aug 18 21:00:48 2022] DELETE /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments/c82f0097-f664-44d9-bd43-5651ef5ab839 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:49.070096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:49.072035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:49.083137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:49.083621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:49.084053 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:49.084761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:49.085211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:49.085695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:49.117790 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cd921c21-1009-4be4-b19b-791ca4929054 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052529 Aug 18 21:00:49.118434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 350/709] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Aug 18 21:00:49 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:00:50.133119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:50.135605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:50.141910 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:50.142391 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:50.142824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:50.143550 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:50.144035 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:50.144458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:50.173661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-16aaa1b7-0af6-45cf-9aec-fd130ea9d82b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045895 Aug 18 21:00:50.174200 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 360/710] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Aug 18 21:00:50 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:00:51.186310 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:51.188494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:51.195433 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:51.195924 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:51.196360 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:51.197052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:51.197505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:51.197931 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:51.226418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e8c0685b-ff81-4870-b91c-ef0d8b12a95c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044152 Aug 18 21:00:51.226969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 351/711] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Aug 18 21:00:51 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:51.294083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:51.294645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:51.301954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:51.302625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:51.303780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:51.304513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:51.304961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:51.305468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:51.331265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:00:51.642848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f726571c-0a76-4433-ac4f-f18e4f7f9a6a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 204 len: 0 microversion: 2.20 time: 0.352420 Aug 18 21:00:51.643409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 361/712] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Aug 18 21:00:51 2022] DELETE /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 21:00:51.651505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:51.652123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:51.658322 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:51.658804 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:51.659239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:51.659964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:51.660416 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:51.660845 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:51.794103 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:51.802188 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:51.804209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:51.805355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f7188eec-1dde-4ebd-82c3-5ced55a4178e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.157766 Aug 18 21:00:51.805942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 352/713] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:00:51 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:00:52.019245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:52.019858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:52.025700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.026186 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.026626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.027324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.027804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.028228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.056211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:00:52.167126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:52.167694 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:52.173686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.174164 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.175180 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.175295 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.175739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.176163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.199217 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lazy-loading 'flavor' on Instance uuid 36afd51b-5953-4414-8efe-b33c3e8a2fda {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:00:52.391194 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a998a11d-c5e2-4858-9563-27230b8330eb tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "DELETE /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 204 len: 0 microversion: 2.1 time: 0.375757 Aug 18 21:00:52.391888 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 362/714] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:00:52 2022] DELETE /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:52.400511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:52.401205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:52.407447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.407928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.408360 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.409044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.409492 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.409913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.527389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9c7a60e1-b2e8-4e47-a952-da4173487c08 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "POST /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda/action" status: 202 len: 0 microversion: 2.1 time: 0.363990 Aug 18 21:00:52.528260 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 353/715] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 21:00:52 2022] POST /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 21:00:52.537307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:52.539518 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:52.547463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:52.555673 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.555924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f9dbc2e5-5ae0-4926-9964-0a8916fdab48 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1507 microversion: 2.1 time: 0.159831 Aug 18 21:00:52.556175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.556499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 363/716] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:52 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:52.557741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.558310 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.558795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.559235 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.690611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:52.699072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-297b2f0d-4c86-455d-a909-315252466375 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.166104 Aug 18 21:00:52.699681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 354/717] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:52 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:52.828924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:52.829679 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:52.835798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.836282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.836747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.837445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:52.837896 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:52.838323 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:52.976292 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:52.985051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:52.986549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:52.987733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4a21f7d7-004d-4b5c-8470-d5e78f364192 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.162791 Aug 18 21:00:52.988369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 364/718] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:00:52 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:00:53.577540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:53.578186 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:53.585173 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:53.585659 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:53.586094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:53.586786 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:53.587241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:53.587697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:53.605516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:53.718801 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:53.720144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:53.721084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:53.726736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ba41e868-d0ed-4aff-8609-d09a36e6596f tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1507 microversion: 2.1 time: 0.153047 Aug 18 21:00:53.727349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 355/719] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:53 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:53.727753 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:53.728242 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:53.728684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:53.729386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:53.729843 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:53.730271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:53.734524 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:53.896796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:53.904770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f19fb86d-1a78-4324-8ae1-c920001fa14f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.188499 Aug 18 21:00:53.905620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 365/720] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:53 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:54.016683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:54.017399 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:54.023784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:54.024273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:54.024706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:54.025420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:54.025855 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:54.026281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:54.159239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:54.167573 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:54.169062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:54.170223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3654cab0-c40c-4354-b4e1-094234e46f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1724 microversion: 2.20 time: 0.162421 Aug 18 21:00:54.170886 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 356/721] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:00:54 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:00:54.748620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:54.749966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:54.756485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:54.757143 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:54.757846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:54.758633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:54.759188 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:54.759856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:54.770828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-a0b94f48-ddd5-4af4-ad74-d5dfef63f62d req-97c00e18-8e7a-447c-9995-686986353458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc448b9-4ec7-434a-b395-d4a344b78179", "name": "network-vif-deleted", "tag": "5fe340e0-9ebc-47a8-b2f9-dcc9d92c95b3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:54.792556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a0b94f48-ddd5-4af4-ad74-d5dfef63f62d req-97c00e18-8e7a-447c-9995-686986353458 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:54.793063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a0b94f48-ddd5-4af4-ad74-d5dfef63f62d req-97c00e18-8e7a-447c-9995-686986353458 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:54.793503 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a0b94f48-ddd5-4af4-ad74-d5dfef63f62d req-97c00e18-8e7a-447c-9995-686986353458 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:54.810396 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-a0b94f48-ddd5-4af4-ad74-d5dfef63f62d req-97c00e18-8e7a-447c-9995-686986353458 service nova] Creating event network-vif-deleted:5fe340e0-9ebc-47a8-b2f9-dcc9d92c95b3 for instance 1cc448b9-4ec7-434a-b395-d4a344b78179 on hv-cinder-85265 Aug 18 21:00:54.815308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-a0b94f48-ddd5-4af4-ad74-d5dfef63f62d req-97c00e18-8e7a-447c-9995-686986353458 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048159 Aug 18 21:00:54.816148 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 357/722] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:00:54.855737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:54.868573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0021ddf5-cd02-4d88-869f-e8d303dcb20e tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1465 microversion: 2.1 time: 0.124345 Aug 18 21:00:54.875206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 366/723] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:54 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1465 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:54.926581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:54.927336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:54.933619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:54.934106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:54.934538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:54.935223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:54.935706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:54.936131 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:55.079122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:55.093502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b6f91fa9-96ed-40c7-b735-210d6966787f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.165044 Aug 18 21:00:55.093502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 358/724] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:54 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:55.195107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:55.210218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:55.210218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:55.210218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:55.210218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:55.210941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:55.210941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:55.210941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:55.277352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:55.286076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:55.288131 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:55.289542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-58aafccd-ef10-4d9f-a0a3-259e7f1b2014 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1657 microversion: 2.20 time: 0.099778 Aug 18 21:00:55.290749 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 367/725] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:00:55 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1657 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:00:55.890442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:55.891045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:55.897829 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:55.898318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:55.898748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:55.899523 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:55.904656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:55.904656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:55.936092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:55.936578 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:55.937034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:55.937458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lazy-loading 'fault' on Instance uuid 1cc448b9-4ec7-434a-b395-d4a344b78179 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:00:55.982283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:55.990225 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-38dac2f3-09ff-4469-966a-eba55ecc5765 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 200 len: 1311 microversion: 2.1 time: 0.103615 Aug 18 21:00:55.991577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 359/726] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:55 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:56.109733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:56.110358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:56.116970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:56.117320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:56.117757 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:56.118469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:56.123010 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:56.123010 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:56.258749 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:56.266609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d84bd0ce-a39f-45ab-a1ff-319d052e629f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.161136 Aug 18 21:00:56.267181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 368/727] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:56 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:56.313575 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:56.314203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:56.320133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:56.320609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:56.321037 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:56.321710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:56.322158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:56.322570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:56.355241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:56.356116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:56.356951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:56.357426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lazy-loading 'fault' on Instance uuid 36c76af8-35e8-4dbe-885d-cb5510af2411 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:00:56.406135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:56.415158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:56.416897 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:56.418118 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f253daf8-f347-4e7e-88c4-65368c991901 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 200 len: 1372 microversion: 2.20 time: 0.108377 Aug 18 21:00:56.418674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 360/728] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:00:56 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:00:56.844699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-9c7fa364-c184-48ce-9ff4-7d3c1b38e21b req-7fbf21ea-c7d1-40b6-9c5a-857dabfeddc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36c76af8-35e8-4dbe-885d-cb5510af2411", "name": "network-vif-deleted", "tag": "2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:56.854674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-9c7fa364-c184-48ce-9ff4-7d3c1b38e21b req-7fbf21ea-c7d1-40b6-9c5a-857dabfeddc5 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:56.855148 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-9c7fa364-c184-48ce-9ff4-7d3c1b38e21b req-7fbf21ea-c7d1-40b6-9c5a-857dabfeddc5 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:56.855609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-9c7fa364-c184-48ce-9ff4-7d3c1b38e21b req-7fbf21ea-c7d1-40b6-9c5a-857dabfeddc5 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:56.866409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-9c7fa364-c184-48ce-9ff4-7d3c1b38e21b req-7fbf21ea-c7d1-40b6-9c5a-857dabfeddc5 service nova] Creating event network-vif-deleted:2dcc8f19-b464-4eb7-9d5f-0dd08fa0f6ca for instance 36c76af8-35e8-4dbe-885d-cb5510af2411 on hv-cinder-85265 Aug 18 21:00:56.871395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-9c7fa364-c184-48ce-9ff4-7d3c1b38e21b req-7fbf21ea-c7d1-40b6-9c5a-857dabfeddc5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030257 Aug 18 21:00:56.871970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 369/729] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:00:57.012236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:57.012838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: 1cc448b9-4ec7-434a-b395-d4a344b78179] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:57.019180 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.019741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.020187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.020866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.021310 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.021727 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.035990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] HTTP exception thrown: Instance 1cc448b9-4ec7-434a-b395-d4a344b78179 could not be found. Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Request method failure captured: Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 HTTP/1.1 Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbG5VsOMS_bHA47YGbs9T8iiAhJ7sT72ojAQ8H0kbJOh8ksbD2jEeQpei16A7FR5Po6xX7fVc4ubiig8qP_kQqbckUucJP-7z1dPwV6WWN-o7_JNk8ZkZiDzqX5ys25l5-Zg0LnhCjUh41AMK1mgLVpRad16ov41Q36Msw82ah5tX4 Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:00:57.037625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_119af0f155d0477cbc4a15a054070278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/119af0f155d0477cbc4a15a054070278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 86c2b496a2c04a0094bf30111bf25669 Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 1cc448b9-4ec7-434a-b395-d4a344b78179 could not be found. Aug 18 21:00:57.039854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '1cc448b9-4ec7-434a-b395-d4a344b78179'} Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc448b9-4ec7-434a-b395-d4a344b78179 could not be found. Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:00:57.040813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc448b9-4ec7-434a-b395-d4a344b78179 could not be found. Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc448b9-4ec7-434a-b395-d4a344b78179 could not be found. Aug 18 21:00:57.042027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.043279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Returning 404 to user: Instance 1cc448b9-4ec7-434a-b395-d4a344b78179 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:00:57.043279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c309edf8-2291-4411-9bb3-56ef41c4a071 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179" status: 404 len: 111 microversion: 2.1 time: 0.031397 Aug 18 21:00:57.043279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 361/730] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:57 2022] GET /compute/v2.1/servers/1cc448b9-4ec7-434a-b395-d4a344b78179 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:00:57.048607 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:57.049189 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:57.055289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.055812 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.056251 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.056950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.057406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.057834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.082257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:00:57.287285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:57.287963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:57.293828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.294309 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.294763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.295481 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.295931 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.296356 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.387195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-995e4af1-b6ab-48a3-8373-e7e0739d85ee tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "DELETE /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 204 len: 0 microversion: 2.1 time: 0.342171 Aug 18 21:00:57.388089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 370/731] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:00:57 2022] DELETE /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:00:57.396576 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:57.397332 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:57.404536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.405141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.405935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.406690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.407628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.408126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.431245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:57.439508 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-08a7af12-1ae3-4015-8814-9cb6a09a5b70 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.156059 Aug 18 21:00:57.440076 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 362/732] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:57 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:57.445193 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:57.445813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:57.452040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.452529 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.452963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.454061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:57.454683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:57.455271 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:57.470041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] HTTP exception thrown: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Request method failure captured: Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 HTTP/1.1 Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qc9UFqLkRA93pAKXKk4NKPKmQx5GNXps1UWqo2UfCz860MmP2FBFBIU4dRI8S8425J9QAZ0dZCFgfWXUv4fODy_0otgITy2R9JcEGsBd-yPnXJJAxRpzcF0XMbWfCerM6akSNg3Vs0x8XNcIGV3wsIds4Av1YwQ5gZAH8Z5O8ohPUI Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:00:57.471630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: cf3712f97958438581b8e153723a1d71 Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:00:57.473383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '36c76af8-35e8-4dbe-885d-cb5510af2411'} Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:00:57.474350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:00:57.475921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:00:57.477197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Returning 404 to user: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:00:57.477197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b7cdb7fc-57af-495f-b6f0-09f2bdfdb34a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 404 len: 111 microversion: 2.20 time: 0.032018 Aug 18 21:00:57.477197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 363/733] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:00:57 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 21:00:57.481634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1ac53a9a-2b73-4d58-bfbe-7a7c9503de57 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '.version_select at 0x7f8b5a46d5e0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:57.552569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:57.560944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a968ed18-da0f-4679-ace5-735e238480ab tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.168425 Aug 18 21:00:57.561578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 371/734] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:57 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:57.575796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1ac53a9a-2b73-4d58-bfbe-7a7c9503de57 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458978149" status: 204 len: 0 microversion: 2.20 time: 0.097626 Aug 18 21:00:57.576409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 364/735] 10.222.0.62 () {60 vars in 1262 bytes} [Thu Aug 18 21:00:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1458978149 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 21:00:58.342473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7c41a08a-1f3f-4b13-ad7d-c86623f84aac tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'create', calling method: .version_select at 0x7f8b5ad85af0>, body: {"keypair": {"name": "tempest-keypair-1491249910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/7q35lcwv+8GndQrREc5SiSYfw4FA19VOEqlCUQHCBPYiY2T/zxnBp4Kjrr/M4t5LRbnpPCfV6daSMJReDzobE3bY8tHv8IoMJwp1W66wT/yB8xWqyqHenLfeZFTqCkQ=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:58.358952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-7c41a08a-1f3f-4b13-ad7d-c86623f84aac tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for project 4600f776fb78446ab25a3ee913934fcc. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:00:58.362813 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-7c41a08a-1f3f-4b13-ad7d-c86623f84aac tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for user cf3712f97958438581b8e153723a1d71 and project 4600f776fb78446ab25a3ee913934fcc. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:00:58.450069 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7c41a08a-1f3f-4b13-ad7d-c86623f84aac tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.111565 Aug 18 21:00:58.450800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 372/736] 10.222.0.62 () {62 vars in 1200 bytes} [Thu Aug 18 21:00:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 21:00:58.464402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:58.465023 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:58.472584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:58.473069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:58.473508 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:58.474292 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:58.474775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:58.475183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:58.582265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:58.583109 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:58.590016 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:58.591122 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:58.591238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:58.592166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:58.592787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:58.593551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:58.614628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:58.622951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-024e074f-a0ae-4785-96c7-d4185e4d4b28 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.162850 Aug 18 21:00:58.623752 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 365/737] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:58 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:58.756603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:58.764933 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-24dd9969-9e6c-4cde-848f-efa93e3d26bd tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1521 microversion: 2.1 time: 0.186596 Aug 18 21:00:58.765528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 373/738] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:58 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:59.644258 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:59.644862 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:59.651870 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:59.656052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:59.656052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:59.656052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:59.656052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:59.656660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:59.786601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:00:59.788310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:00:59.807245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:59.808340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:59.810159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:59.811307 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:59.812212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:59.812819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:59.821125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:59.831744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-15f86e4a-4e86-4b6d-bb04-5b0b78763e73 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.190830 Aug 18 21:00:59.832293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 366/739] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:59 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:00:59.911023 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-b3bc0152-9805-4257-a101-1eb2bf632379 req-2762c9d5-c421-4613-96fa-aec60c3d4c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df6d725b-6c0e-43f3-b240-99f9a739d63f", "name": "network-vif-deleted", "tag": "f5399b38-95d8-4997-bf45-40f7f8ef7c71"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:00:59.921207 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b3bc0152-9805-4257-a101-1eb2bf632379 req-2762c9d5-c421-4613-96fa-aec60c3d4c59 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:00:59.922171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b3bc0152-9805-4257-a101-1eb2bf632379 req-2762c9d5-c421-4613-96fa-aec60c3d4c59 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:00:59.922788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b3bc0152-9805-4257-a101-1eb2bf632379 req-2762c9d5-c421-4613-96fa-aec60c3d4c59 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:00:59.924448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:00:59.933316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-935586f9-b4ad-4d77-8fd8-a39c0d80af05 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1479 microversion: 2.1 time: 0.150621 Aug 18 21:00:59.934030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 374/740] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:00:59 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1479 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:00:59.934706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-b3bc0152-9805-4257-a101-1eb2bf632379 req-2762c9d5-c421-4613-96fa-aec60c3d4c59 service nova] Creating event network-vif-deleted:f5399b38-95d8-4997-bf45-40f7f8ef7c71 for instance df6d725b-6c0e-43f3-b240-99f9a739d63f on hv-cinder-85265 Aug 18 21:00:59.939754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-b3bc0152-9805-4257-a101-1eb2bf632379 req-2762c9d5-c421-4613-96fa-aec60c3d4c59 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034047 Aug 18 21:00:59.940324 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 367/741] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:01:00.853651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:00.854263 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:00.860785 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:00.861278 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:00.861716 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:00.862415 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:00.862871 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:00.863533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:00.957418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:00.957418 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:00.963226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:00.963740 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:00.964178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:00.964891 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:00.965346 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:00.965820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:00.998866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:00.999387 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:00.999823 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:01.000272 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lazy-loading 'fault' on Instance uuid df6d725b-6c0e-43f3-b240-99f9a739d63f {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:01:01.009995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:01.018448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-eb0ceb91-642a-475c-9409-37feba4033a4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.169253 Aug 18 21:01:01.019219 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 375/742] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:00 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:01.024327 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-380661523", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18e2e06f-6daf-4f2e-8339-d1cb00af2b1b"}], "security_groups": [{"name": "tempest-securitygroup--1990294352"}], "key_name": "tempest-keypair-1491249910", "user_data": "}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:01.055514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86c2b496a2c04a0094bf30111bf25669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119af0f155d0477cbc4a15a054070278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:01.062414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e76eeb1c-9a5e-440d-b0d4-5d13f78abafe tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 200 len: 1311 microversion: 2.1 time: 0.111948 Aug 18 21:01:01.062982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 368/743] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:00 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:01.139315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.network.neutron [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] validate_networks() for [('18e2e06f-6daf-4f2e-8339-d1cb00af2b1b', None, None, None, None, None)] {{(pid=127936) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:01:01.548137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Flavor limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:01:01.548563 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Image limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:01:01.549040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Flavor pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:01:01.549513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Image pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:01:01.549928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:01:01.559273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:01.559822 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:01.560266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:01.561205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:01.561665 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:01.562095 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:01.579893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for project 4600f776fb78446ab25a3ee913934fcc. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:01:01.583856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Getting quotas for user cf3712f97958438581b8e153723a1d71 and project 4600f776fb78446ab25a3ee913934fcc. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:01:01.594673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Going to run 1 instances... {{(pid=127936) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:01:01.597002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127936) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:01:01.714144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-016d2490-8522-4343-9df8-9bde22786a44 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.693824 Aug 18 21:01:01.714793 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 376/744] 10.222.0.62 () {62 vars in 1188 bytes} [Thu Aug 18 21:01:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 21:01:01.725591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bd70dcba-a426-4664-a35c-c3a9fc9a2184 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:01.726665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bd70dcba-a426-4664-a35c-c3a9fc9a2184 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:01.782761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bd70dcba-a426-4664-a35c-c3a9fc9a2184 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:01.791033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bd70dcba-a426-4664-a35c-c3a9fc9a2184 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:01.792558 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bd70dcba-a426-4664-a35c-c3a9fc9a2184 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:01.793932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bd70dcba-a426-4664-a35c-c3a9fc9a2184 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1281 microversion: 2.20 time: 0.072221 Aug 18 21:01:01.794486 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 369/745] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:01 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1281 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:02.041638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:02.042981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:02.045830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:02.049257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:02.049740 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:02.050181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:02.050878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:02.051335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:02.051801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:02.089828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:02.091045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] [instance: df6d725b-6c0e-43f3-b240-99f9a739d63f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:02.097442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:02.098023 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:02.098706 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:02.099442 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:02.099898 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:02.100537 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:02.117502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] HTTP exception thrown: Instance df6d725b-6c0e-43f3-b240-99f9a739d63f could not be found. Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Request method failure captured: Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f HTTP/1.1 Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbG5VsOMS_bHA47YGbs9T8iiAhJ7sT72ojAQ8H0kbJOh8ksbD2jEeQpei16A7FR5Po6xX7fVc4ubiig8qP_kQqbckUucJP-7z1dPwV6WWN-o7_JNk8ZkZiDzqX5ys25l5-Zg0LnhCjUh41AMK1mgLVpRad16ov41Q36Msw82ah5tX4 Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:01:02.119660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_119af0f155d0477cbc4a15a054070278"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/119af0f155d0477cbc4a15a054070278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/119af0f155d0477cbc4a15a054070278"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 119af0f155d0477cbc4a15a054070278 Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1033078234 Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 86c2b496a2c04a0094bf30111bf25669 Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1033078234-project Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance df6d725b-6c0e-43f3-b240-99f9a739d63f could not be found. Aug 18 21:01:02.121042 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': 'df6d725b-6c0e-43f3-b240-99f9a739d63f'} Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df6d725b-6c0e-43f3-b240-99f9a739d63f could not be found. Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:01:02.121788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df6d725b-6c0e-43f3-b240-99f9a739d63f could not be found. Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df6d725b-6c0e-43f3-b240-99f9a739d63f could not be found. Aug 18 21:01:02.122970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:02.124174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] Returning 404 to user: Instance df6d725b-6c0e-43f3-b240-99f9a739d63f could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:01:02.124174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d12458a6-a9f7-4949-a1db-cc45ac50f244 tempest-ServerRescueNegativeTestJSON-1033078234 tempest-ServerRescueNegativeTestJSON-1033078234-project] 10.222.0.62 "GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f" status: 404 len: 111 microversion: 2.1 time: 0.036915 Aug 18 21:01:02.124174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 370/746] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:02 2022] GET /compute/v2.1/servers/df6d725b-6c0e-43f3-b240-99f9a739d63f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:01:02.201106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:02.205983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b7a73a81-193b-4eb0-9fcc-5b6cfcd6895c tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.168681 Aug 18 21:01:02.206544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 377/747] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:02 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:02.817741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:02.818509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:02.825394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:02.826986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:02.826986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:02.826986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:02.827464 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:02.827882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:02.899035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:02.908468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:02.909977 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:02.912957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f45baa70-c103-4442-abc8-e5fab6ce1e1f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1285 microversion: 2.20 time: 0.097438 Aug 18 21:01:02.912957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 371/748] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:02 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:03.228820 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:03.229439 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:03.240379 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:03.240910 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:03.241362 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:03.242664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:03.243132 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:03.243592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:03.413299 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:03.421741 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8183962b-f7d0-43e5-bf93-b0f912586640 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.197649 Aug 18 21:01:03.422243 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 378/749] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:03 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:03.933236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:03.933842 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:03.940414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:03.940902 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:03.941336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:03.942080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:03.942535 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:03.942960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:04.004793 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:04.014844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:04.016376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:04.017900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-55627453-ea42-4fbf-865d-19b7c22a4a3c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1341 microversion: 2.20 time: 0.088542 Aug 18 21:01:04.018453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 372/750] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:03 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1341 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:04.443110 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:04.444730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:04.453640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:04.454126 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:04.454562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:04.455271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:04.455760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:04.456181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:04.734962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:04.745718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d050feed-e9f6-4a35-8bc6-d84125521c6e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.306307 Aug 18 21:01:04.747456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 379/751] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:04 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:05.041199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:05.041932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:05.048988 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:05.049515 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:05.049958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:05.050680 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:05.051136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:05.051631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:05.117471 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:05.126618 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:05.128319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:05.129676 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ad0ea047-34a1-4f33-a28b-bc663ea7314b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1339 microversion: 2.20 time: 0.092482 Aug 18 21:01:05.139737 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 373/752] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:05 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:05.768444 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:05.769063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:05.775791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:05.776281 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:05.776750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:05.777555 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:05.777917 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:05.778342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:05.962772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:05.971185 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-26104ffb-30ab-4c2b-b722-18ec30ab66c6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.206512 Aug 18 21:01:05.972152 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 380/753] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:05 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:06.152966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:06.153714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:06.160895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:06.161300 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:06.161729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:06.162583 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:06.164251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:06.164683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:06.302295 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:06.316364 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:06.318055 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:06.319516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-90d9de51-0632-49d4-a90a-86601bc849af tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.170503 Aug 18 21:01:06.320705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 374/754] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:06 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:01:06.992881 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:06.994326 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:07.008335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:07.008335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:07.008335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:07.008335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:07.008684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:07.008684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:07.213068 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:07.227470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b4e28439-475f-4231-9ca0-f1be511e922d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.237367 Aug 18 21:01:07.229107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 381/755] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:06 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:07.350760 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:07.352027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:07.369216 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:07.370083 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:07.370609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:07.371452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:07.372607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:07.373173 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:07.387653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-1fab2c2c-adb5-452d-9db8-01a73d68273f req-9d310827-134d-4ac0-82e1-23454186e642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e18af4-e43d-4a3e-8927-934dd31062c1", "tag": "325a8ac4-261b-41ac-a3ca-a40a5b74b70f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:07.400528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1fab2c2c-adb5-452d-9db8-01a73d68273f req-9d310827-134d-4ac0-82e1-23454186e642 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:07.401560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1fab2c2c-adb5-452d-9db8-01a73d68273f req-9d310827-134d-4ac0-82e1-23454186e642 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:07.402157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1fab2c2c-adb5-452d-9db8-01a73d68273f req-9d310827-134d-4ac0-82e1-23454186e642 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:07.427264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-1fab2c2c-adb5-452d-9db8-01a73d68273f req-9d310827-134d-4ac0-82e1-23454186e642 service nova] Creating event network-changed:325a8ac4-261b-41ac-a3ca-a40a5b74b70f for instance 93e18af4-e43d-4a3e-8927-934dd31062c1 on hv-cinder-85265 Aug 18 21:01:07.439070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-1fab2c2c-adb5-452d-9db8-01a73d68273f req-9d310827-134d-4ac0-82e1-23454186e642 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055502 Aug 18 21:01:07.440603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 382/756] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:01:07.608940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:07.617946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:07.619701 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:07.620821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3a993c3b-5c18-4139-892a-a25c5aac6459 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.281804 Aug 18 21:01:07.621366 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 375/757] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:07 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:08.250202 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:08.250907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:08.258549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.259265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.259910 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.260782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.261409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.261863 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.266274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:08.469574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:08.477774 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-801fec8c-15bf-4b71-81a2-f5c27c06e112 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1509 microversion: 2.1 time: 0.231716 Aug 18 21:01:08.478343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 383/758] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:08 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:08.498594 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:08.504554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:08.504554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:08.506279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.506755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.507180 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.507917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.508407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.508822 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.525563 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:08.540257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127937) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 21:01:08.643437 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:08.644057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:08.650303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.650846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.651229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.651962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.652413 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.652840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.787835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:08.796878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:08.798367 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:08.799617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c1ffcbe4-6f2e-4c17-a428-49dbc4f780f6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.160351 Aug 18 21:01:08.800168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 384/759] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:08 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:01:08.814692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0e2a6ccd-70f2-4f2c-90ec-26b988f162f6 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "POST /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda/action" status: 202 len: 0 microversion: 2.1 time: 0.318983 Aug 18 21:01:08.817500 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 376/760] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 21:01:08 2022] POST /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:01:08.825807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:08.826425 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:08.832303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.832790 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.833220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.834045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:08.834503 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:08.834928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:08.978861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:08.988453 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e20dabed-46e9-4e94-ad83-1cbeb9367115 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1517 microversion: 2.1 time: 0.166901 Aug 18 21:01:08.989580 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 385/761] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:08 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:09.823992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:09.824791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:09.832185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:09.832679 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:09.833123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:09.833912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:09.834301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:09.834726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:09.978910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:09.987250 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:09.988779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:09.989904 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fce35171-1ac4-4af9-bbb1-4a486ef15d08 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.171546 Aug 18 21:01:09.990462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 377/762] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:09 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:01:10.010212 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:10.010953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:10.018193 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:10.018685 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:10.019117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:10.019893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:10.020348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:10.020778 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:10.164541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:10.178615 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-895c389f-a3fd-477d-a7c5-5335bab1616b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1517 microversion: 2.1 time: 0.167481 Aug 18 21:01:10.178615 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 386/763] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:10 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:11.013637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:11.014259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:11.021138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:11.021632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:11.022068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:11.022893 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:11.024030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:11.024462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:11.166089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:11.175076 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:11.176784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:11.177775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-137a267f-2a5e-4f07-b73b-3d99d688528b tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.168385 Aug 18 21:01:11.178345 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 378/764] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:11 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:01:11.196089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:11.196705 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:11.203531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:11.204011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:11.204443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:11.205139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:11.205583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:11.208867 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:11.305779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6f4bde79-9232-4dda-b5df-a9e2707b5ec2 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a3181f0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:11.428187 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:11.435577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6f4bde79-9232-4dda-b5df-a9e2707b5ec2 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/33eb8603-6526-4ae4-b9cb-8bc2f9cf5e04" status: 200 len: 351 microversion: 2.1 time: 0.135336 Aug 18 21:01:11.436343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 379/765] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:01:11 2022] GET /compute/v2.1/os-volumes/33eb8603-6526-4ae4-b9cb-8bc2f9cf5e04 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:11.441011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-ae657afd-7adb-43a0-9a06-70d40129773a req-6c80de4a-d0c2-4bf1-8c38-bb6155d6f660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36afd51b-5953-4414-8efe-b33c3e8a2fda", "name": "network-vif-unplugged", "status": "completed", "tag": "febcfc1a-0d17-4c46-ba69-4e78e95c42a3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:11.446431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0167e232-14f5-4d9a-a190-a20fa670be6b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1517 microversion: 2.1 time: 0.255071 Aug 18 21:01:11.451702 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-ae657afd-7adb-43a0-9a06-70d40129773a req-6c80de4a-d0c2-4bf1-8c38-bb6155d6f660 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:11.452183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-ae657afd-7adb-43a0-9a06-70d40129773a req-6c80de4a-d0c2-4bf1-8c38-bb6155d6f660 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:11.452620 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-ae657afd-7adb-43a0-9a06-70d40129773a req-6c80de4a-d0c2-4bf1-8c38-bb6155d6f660 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:11.460372 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 387/766] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:11 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1517 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:11.464516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.compute.server_external_events [req-ae657afd-7adb-43a0-9a06-70d40129773a req-6c80de4a-d0c2-4bf1-8c38-bb6155d6f660 service nova] Unable to find a host for instance 36afd51b-5953-4414-8efe-b33c3e8a2fda. Dropping event network-vif-unplugged {{(pid=127937) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 21:01:11.467426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-ae657afd-7adb-43a0-9a06-70d40129773a req-6c80de4a-d0c2-4bf1-8c38-bb6155d6f660 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028175 Aug 18 21:01:11.467426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 380/767] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 21:01:12.203677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:12.204457 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:12.206512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.207282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=10 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.214211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:12.214822 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:12.215304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:12.216097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:12.216629 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:12.217177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:12.366546 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:12.376137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:12.377720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:12.378836 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ce4f25a9-56e1-419f-969a-f45f29812d47 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.179650 Aug 18 21:01:12.379419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 388/768] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:12 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:01:12.468150 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:12.469417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:12.471564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:12.477189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:12.477682 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:12.478123 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:12.478838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:12.479281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:12.479744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:12.636460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:12.648513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f55279a9-adf7-4aa1-a588-0864d003d16d tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1519 microversion: 2.1 time: 0.184374 Aug 18 21:01:12.649512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 381/769] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:12 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:13.131912 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eaf099b0-6ee0-4f4b-bea4-3203ec61cd1a tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a330f70>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:13.187651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-eaf099b0-6ee0-4f4b-bea4-3203ec61cd1a tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/1a0354fe-ea36-4797-920a-bb5eaf40c61f" status: 200 len: 350 microversion: 2.1 time: 0.065085 Aug 18 21:01:13.188208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 389/770] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:01:13 2022] GET /compute/v2.1/os-volumes/1a0354fe-ea36-4797-920a-bb5eaf40c61f => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:13.403555 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:13.404234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:13.412962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:13.414313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:13.415038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:13.416269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:13.417036 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:13.417863 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:13.587429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:13.596121 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:13.598019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:13.599176 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f64783fc-4e42-43a6-94d2-74cd9ace0642 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.199674 Aug 18 21:01:13.599787 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 382/771] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:13 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:13.670907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:13.671572 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:13.677745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:13.678274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:13.678754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:13.679559 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:13.680048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:13.680480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:13.858218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:13.868186 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2e58b4bb-df34-42f6-af00-bc673ecddbb1 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.201157 Aug 18 21:01:13.868911 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 390/772] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:13 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:14.626830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:14.627621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:14.635467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:14.635956 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:14.636452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:14.637144 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:14.637588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:14.638004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:14.784458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:14.793741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:14.795243 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:14.796389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-af9ac188-c236-4326-84b3-fb1391d61e67 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.174929 Aug 18 21:01:14.796964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 383/773] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:14 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:14.889769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:14.890344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:14.896573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:14.897063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:14.897505 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:14.898718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:14.899172 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:14.899633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:15.002931 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-180949086"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:15.003541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:15.010111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:15.012369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:15.012369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:15.012369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:15.012369 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:15.012958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:15.048255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:15.057838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-10959790-6859-4e40-87ff-fe8090103289 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.172008 Aug 18 21:01:15.058482 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 391/774] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:14 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:15.188417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.network.security_group_api [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Removing security group b927f3ad-da64-445b-9005-3385b839db89 from port 029a6b88-b666-4955-8888-cf641a23b712 Aug 18 21:01:15.651275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e89834c5-2c3b-4063-bfb4-2453035e4b0a tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/action" status: 202 len: 0 microversion: 2.1 time: 0.652363 Aug 18 21:01:15.656725 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 384/775] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 21:01:14 2022] POST /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/action => generated 0 bytes in 654 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:01:15.687760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-89c79a5e-3c92-4e15-b3fb-4b09e99b0e10 req-a9990db6-9dc0-45b8-8a0a-25070c971a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2581e39c-49df-4aa0-8e61-4351d31907d8", "tag": "029a6b88-b666-4955-8888-cf641a23b712"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:15.705344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-89c79a5e-3c92-4e15-b3fb-4b09e99b0e10 req-a9990db6-9dc0-45b8-8a0a-25070c971a83 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:15.706561 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-89c79a5e-3c92-4e15-b3fb-4b09e99b0e10 req-a9990db6-9dc0-45b8-8a0a-25070c971a83 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:15.707506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-89c79a5e-3c92-4e15-b3fb-4b09e99b0e10 req-a9990db6-9dc0-45b8-8a0a-25070c971a83 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:15.727537 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-89c79a5e-3c92-4e15-b3fb-4b09e99b0e10 req-a9990db6-9dc0-45b8-8a0a-25070c971a83 service nova] Creating event network-changed:029a6b88-b666-4955-8888-cf641a23b712 for instance 2581e39c-49df-4aa0-8e61-4351d31907d8 on hv-cinder-85265 Aug 18 21:01:15.736762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-89c79a5e-3c92-4e15-b3fb-4b09e99b0e10 req-a9990db6-9dc0-45b8-8a0a-25070c971a83 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056933 Aug 18 21:01:15.738215 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 392/776] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:15.819262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:15.820758 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:15.827743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:15.831327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:15.831327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:15.831327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:15.831327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:15.831761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:15.983304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-ff3d0cca-5f68-424e-ba2b-30fbf90e2de4 req-0039311f-64d4-4303-9b32-f0dadbc15c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e18af4-e43d-4a3e-8927-934dd31062c1", "name": "network-vif-plugged", "status": "completed", "tag": "325a8ac4-261b-41ac-a3ca-a40a5b74b70f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:16.008936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:16.013962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ff3d0cca-5f68-424e-ba2b-30fbf90e2de4 req-0039311f-64d4-4303-9b32-f0dadbc15c8a service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:16.018483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ff3d0cca-5f68-424e-ba2b-30fbf90e2de4 req-0039311f-64d4-4303-9b32-f0dadbc15c8a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:16.018924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ff3d0cca-5f68-424e-ba2b-30fbf90e2de4 req-0039311f-64d4-4303-9b32-f0dadbc15c8a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:16.021872 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:16.023457 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:16.031005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d8c4b40d-160f-4a75-9525-443d0ce9718d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.214683 Aug 18 21:01:16.031005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 385/777] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:15 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:16.051502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-ff3d0cca-5f68-424e-ba2b-30fbf90e2de4 req-0039311f-64d4-4303-9b32-f0dadbc15c8a service nova] Creating event network-vif-plugged:325a8ac4-261b-41ac-a3ca-a40a5b74b70f for instance 93e18af4-e43d-4a3e-8927-934dd31062c1 on hv-cinder-85265 Aug 18 21:01:16.065181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-ff3d0cca-5f68-424e-ba2b-30fbf90e2de4 req-0039311f-64d4-4303-9b32-f0dadbc15c8a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093844 Aug 18 21:01:16.066401 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 393/778] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:16.098971 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.101901 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:16.114774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:16.119928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:16.119928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:16.119928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:16.119928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:16.120575 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:16.243721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-337ce7ed-4d11-4c6e-ae5d-70a552363999 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a251790>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.313463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-337ce7ed-4d11-4c6e-ae5d-70a552363999 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7671a35e-5d05-4252-8c3e-f4ac744f1fd0" status: 200 len: 351 microversion: 2.1 time: 0.077350 Aug 18 21:01:16.314357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 394/779] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes/7671a35e-5d05-4252-8c3e-f4ac744f1fd0 => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:16.329137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-aa09aebb-7818-4dba-ab93-85c8516d76f7 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a25dc10>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.430774 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-aa09aebb-7818-4dba-ab93-85c8516d76f7 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.105320 Aug 18 21:01:16.431752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 395/780] 10.222.0.62 () {58 vars in 1134 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:16.447288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-aae9399b-6c54-4bd6-8ccb-eb1125caad34 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a1fa940>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.485703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:16.496106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3b1e0ac4-3265-48a8-97c5-d0e3ba2c5acf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.406500 Aug 18 21:01:16.497052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 386/781] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:16.551264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-aae9399b-6c54-4bd6-8ccb-eb1125caad34 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107873 Aug 18 21:01:16.551858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 396/782] 10.222.0.62 () {58 vars in 1149 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:16.565128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-48c862ac-05c6-4662-a7bd-8557c52d72b0 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a6f55e0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.654473 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-48c862ac-05c6-4662-a7bd-8557c52d72b0 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093139 Aug 18 21:01:16.655342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 387/783] 10.222.0.62 () {58 vars in 1134 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:16.667798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a942a667-af6b-44ae-a272-1c84d9e7abdf tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5ad85af0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.752839 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a942a667-af6b-44ae-a272-1c84d9e7abdf tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088777 Aug 18 21:01:16.753488 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 397/784] 10.222.0.62 () {58 vars in 1167 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:16.767878 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f525a044-70a3-4712-92f9-49ab9f9bba35 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a2c8b80>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.863683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f525a044-70a3-4712-92f9-49ab9f9bba35 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092607 Aug 18 21:01:16.863683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 388/785] 10.222.0.62 () {58 vars in 1170 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:16.870074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a23addcf-6a12-4fcd-8f71-796af7b3fe5b tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a2cd0d0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:16.960512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a23addcf-6a12-4fcd-8f71-796af7b3fe5b tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.094149 Aug 18 21:01:16.961830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 398/786] 10.222.0.62 () {58 vars in 1155 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:16.974606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a3d92d12-0aeb-4776-8df9-08f300423c5f tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a3c3c10>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:17.055328 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:17.056467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:17.059256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a3d92d12-0aeb-4776-8df9-08f300423c5f tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088566 Aug 18 21:01:17.060450 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 389/787] 10.222.0.62 () {58 vars in 1188 bytes} [Thu Aug 18 21:01:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:01:17.063938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:17.064431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:17.064864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:17.065862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:17.066316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:17.066736 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:17.076445 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-aa61ee7e-4bbd-4ee9-8059-95bbb1460f89 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] Calling method '.version_select at 0x7f8b5a4da940>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:17.165291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-aa61ee7e-4bbd-4ee9-8059-95bbb1460f89 tempest-VolumesTestJSON-658400949 tempest-VolumesTestJSON-658400949-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092792 Aug 18 21:01:17.166604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 390/788] 10.222.0.62 () {58 vars in 1155 bytes} [Thu Aug 18 21:01:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:17.214763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:17.223805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:17.225344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:17.226532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-85698b4a-90e4-4de4-bc99-a34ae2a888c5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.177006 Aug 18 21:01:17.227099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 399/789] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:17 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:01:17.517479 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:17.518091 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:17.524901 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:17.525393 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:17.526086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:17.526981 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:17.527465 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:17.527896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:17.649129 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:17.649975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:17.656430 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:17.657087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:17.657538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:17.658270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:17.664378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:17.664920 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:17.718949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:17.727844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cdac9e3c-d3f5-4e89-b684-f802206a3b15 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.214174 Aug 18 21:01:17.728601 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 391/790] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:17 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:17.755640 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-bca05334-f73f-4aa1-b235-d9275f2f5913 req-e3c00ec0-d9b4-4729-9669-f1d4aa53d9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2581e39c-49df-4aa0-8e61-4351d31907d8", "tag": "029a6b88-b666-4955-8888-cf641a23b712"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:17.766478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-bca05334-f73f-4aa1-b235-d9275f2f5913 req-e3c00ec0-d9b4-4729-9669-f1d4aa53d9f9 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:17.766952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-bca05334-f73f-4aa1-b235-d9275f2f5913 req-e3c00ec0-d9b4-4729-9669-f1d4aa53d9f9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:17.767839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-bca05334-f73f-4aa1-b235-d9275f2f5913 req-e3c00ec0-d9b4-4729-9669-f1d4aa53d9f9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:17.769207 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lazy-loading 'services' on Instance uuid 2581e39c-49df-4aa0-8e61-4351d31907d8 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:01:17.779761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-bca05334-f73f-4aa1-b235-d9275f2f5913 req-e3c00ec0-d9b4-4729-9669-f1d4aa53d9f9 service nova] Creating event network-changed:029a6b88-b666-4955-8888-cf641a23b712 for instance 2581e39c-49df-4aa0-8e61-4351d31907d8 on hv-cinder-85265 Aug 18 21:01:17.785252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-bca05334-f73f-4aa1-b235-d9275f2f5913 req-e3c00ec0-d9b4-4729-9669-f1d4aa53d9f9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033324 Aug 18 21:01:17.785912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 392/791] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:01:18.047662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-216484f6-640e-4805-bd33-fcb59b6fd0aa tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments/d66112f5-1b39-4ced-be2e-314061918ff1" status: 202 len: 0 microversion: 2.1 time: 0.403018 Aug 18 21:01:18.050696 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 400/792] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:01:17 2022] DELETE /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments/d66112f5-1b39-4ced-be2e-314061918ff1 => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 21:01:18.057813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:18.060401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:18.067022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:18.067597 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:18.068035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:18.068926 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:18.069384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:18.069813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:18.102253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e91369b7-5ee7-46ca-bad7-97dd238ca4bb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048942 Aug 18 21:01:18.103320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 393/793] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:01:18 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:18.250002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:18.250711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:18.258340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:18.258823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:18.259263 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:18.260028 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:18.260498 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:18.260927 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:18.439538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:18.448462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:18.449968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:18.451055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-67069aa0-7f64-42ac-93e5-017bfa805bf2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1407 microversion: 2.20 time: 0.205387 Aug 18 21:01:18.451961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 401/794] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:18 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:18.749033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:18.749654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:18.759550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:18.759550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:18.759550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:18.759550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:18.759935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:18.759935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:18.897757 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:18.905684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-df5163c2-ef5c-41a4-b7b9-84aa6f73dbb0 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.160517 Aug 18 21:01:18.906566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 394/795] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:18 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:19.115240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:19.118207 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:19.124621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.125113 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.125654 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:19.126363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.126817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.127465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:19.158646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-200c2c9a-1225-42e5-bc7b-258dfcb451eb tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047295 Aug 18 21:01:19.159223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 402/796] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:01:19 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:01:19.474827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:19.475479 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:19.482094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.482582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.483016 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:19.483758 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.484236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.484664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:19.618340 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:19.626647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:19.628283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:19.629463 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1afd3382-7511-44d1-887e-e9cc0c1a047c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1600 microversion: 2.20 time: 0.158556 Aug 18 21:01:19.630165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 395/797] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:01:19 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1600 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:01:19.652317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:19.652879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:19.659714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.662636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.662636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:19.662636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.662636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.663023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:19.742866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cb2b1a09-a40d-49bb-8187-7ca9ac2a8f2a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095495 Aug 18 21:01:19.743509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 403/798] 10.222.0.62 () {60 vars in 1316 bytes} [Thu Aug 18 21:01:19 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:01:19.927380 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:19.927998 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:19.934752 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.935230 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.935764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:19.936453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:19.936899 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:19.937509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:20.089554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:20.099714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-72fae035-7df2-4cd3-937f-a0ac30e029bc tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.176123 Aug 18 21:01:20.101128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 396/799] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:19 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:20.170953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:20.173626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:20.181613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:20.182409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:20.182945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:20.183720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:20.185528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:20.185528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:20.216340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-84437d23-ae6d-47ee-8e41-aedfe2c2ed54 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049254 Aug 18 21:01:20.216944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 404/800] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:01:20 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:01:20.227605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:20.228197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:20.234384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:20.234895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:20.235504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:20.236214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:20.236705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:20.237133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:20.313470 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] HTTP exception thrown: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 is not attached to volume d66112f5-1b39-4ced-be2e-314061918ff1 Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Request method failure captured: Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: DELETE /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments/d66112f5-1b39-4ced-be2e-314061918ff1 HTTP/1.1 Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qejMBaYj0bWrNRmkc4hO9vAYm0g_P71wZWCXG-tcErySQYGU-RHGncH3_vu7ZVxxfXOin01j4QthAg0k7pnAS52EMMxDAGw8Ley5ox8Ms4MTsGDJQOx3jGVd4z5rOrB-2eRNJaq1Ognp-co7h5eEQFGSOt6eLcQm46gHs3kVYDGke4 Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 3ed3d374c7a145918d9ad3b770cb562b Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-TestMinimumBasicScenario-1563995049 Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:01:20.315847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-TestMinimumBasicScenario-1563995049 Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 3ed3d374c7a145918d9ad3b770cb562b Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1563995049 Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-TestMinimumBasicScenario-1563995049-project Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: d87dd0b10a4a4db39935df509bc8eb0b Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-TestMinimumBasicScenario-1563995049-project Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:01:20.317560 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 is not attached to volume d66112f5-1b39-4ced-be2e-314061918ff1 Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'server_id': '2581e39c-49df-4aa0-8e61-4351d31907d8', 'id': 'd66112f5-1b39-4ced-be2e-314061918ff1'} Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d66112f5-1b39-4ced-be2e-314061918ff1. Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:01:20.318540 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 is not attached to volume d66112f5-1b39-4ced-be2e-314061918ff1 Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 is not attached to volume d66112f5-1b39-4ced-be2e-314061918ff1 Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:01:20.320765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Returning 404 to user: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 is not attached to volume d66112f5-1b39-4ced-be2e-314061918ff1 {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:01:20.322472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bcd2d9a9-ba37-4a9b-922c-0d29da4679d3 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments/d66112f5-1b39-4ced-be2e-314061918ff1" status: 404 len: 154 microversion: 2.1 time: 0.093721 Aug 18 21:01:20.322472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 397/801] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:01:20 2022] DELETE /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8/os-volume_attachments/d66112f5-1b39-4ced-be2e-314061918ff1 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:01:21.114315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-ea3cc5d6-b56e-4a0f-a7f0-0a0bc855f928 req-ad04812f-183d-41ea-87f0-0aea751e4b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e18af4-e43d-4a3e-8927-934dd31062c1", "tag": "325a8ac4-261b-41ac-a3ca-a40a5b74b70f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:21.138621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:21.138621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:21.139087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ea3cc5d6-b56e-4a0f-a7f0-0a0bc855f928 req-ad04812f-183d-41ea-87f0-0aea751e4b5a service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:21.139087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ea3cc5d6-b56e-4a0f-a7f0-0a0bc855f928 req-ad04812f-183d-41ea-87f0-0aea751e4b5a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:21.139087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-ea3cc5d6-b56e-4a0f-a7f0-0a0bc855f928 req-ad04812f-183d-41ea-87f0-0aea751e4b5a service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:21.139435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:21.139435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:21.139435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:21.139435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:21.139799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:21.139799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:21.143851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-ea3cc5d6-b56e-4a0f-a7f0-0a0bc855f928 req-ad04812f-183d-41ea-87f0-0aea751e4b5a service nova] Creating event network-changed:325a8ac4-261b-41ac-a3ca-a40a5b74b70f for instance 93e18af4-e43d-4a3e-8927-934dd31062c1 on hv-cinder-85265 Aug 18 21:01:21.149597 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-ea3cc5d6-b56e-4a0f-a7f0-0a0bc855f928 req-ad04812f-183d-41ea-87f0-0aea751e4b5a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038816 Aug 18 21:01:21.150364 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 405/802] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:01:21.356796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:21.361716 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:21.370161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c7d3d190-1d75-4cce-8f8b-a24b26c72c06 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.251860 Aug 18 21:01:21.370710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 398/803] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:21 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:21.779874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:21.780729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:21.787438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:21.788272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:21.789479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:21.790380 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:21.790993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:21.792166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:21.821473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:01:21.857133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:22.204106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1a8dc39e-c38e-49da-a2d0-ae31bd4d72a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 204 len: 0 microversion: 2.1 time: 0.428748 Aug 18 21:01:22.208497 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 406/804] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:01:21 2022] DELETE /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:01:22.215509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:22.215509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:22.227621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:22.228145 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:22.228749 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:22.229464 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:22.229917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:22.230371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:22.392521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:22.393260 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:22.398545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:22.406665 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:22.406915 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bd80824d-2879-4141-a914-dc25980ece73 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1553 microversion: 2.1 time: 0.196806 Aug 18 21:01:22.407265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 399/805] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:22 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:22.407541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:22.408049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:22.408755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:22.409315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:22.409747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:22.556258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:22.564289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4dcdf924-8d8f-4773-a717-3e5bc8474df3 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.176140 Aug 18 21:01:22.564855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 407/806] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:22 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:23.428349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:23.428964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:23.436514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:23.436980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:23.437417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:23.438110 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:23.438562 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:23.438990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:23.585671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:23.586974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:23.594283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:23.595127 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:23.595827 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:23.596780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:23.597455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:23.598399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:23.612174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:23.625686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-728b6fab-72ae-42fb-81bb-3046336330b8 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1553 microversion: 2.1 time: 0.201233 Aug 18 21:01:23.627032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 400/807] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:23 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:23.754337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:23.765307 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dc0127b7-888d-49c5-9d2a-390fbf7ce485 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.183095 Aug 18 21:01:23.766169 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 408/808] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:23 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:24.647577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:24.647577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:24.656686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:24.657382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:24.658425 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:24.659259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:24.659836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:24.660352 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:24.786387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:24.786987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:24.794287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:24.794784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:24.795223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:24.795973 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:24.796434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:24.796866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:24.808331 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:24.816359 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cfd441fa-37dc-4afb-8f14-6b5a83a88771 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1553 microversion: 2.1 time: 0.173317 Aug 18 21:01:24.816966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 401/809] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:24 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:25.000353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-b563feff-fdce-4bd1-9ecd-54b450f34df4 req-5c81c979-35ce-4aca-85c1-8fd21e3a27f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2581e39c-49df-4aa0-8e61-4351d31907d8", "name": "network-vif-deleted", "tag": "029a6b88-b666-4955-8888-cf641a23b712"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:25.012190 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b563feff-fdce-4bd1-9ecd-54b450f34df4 req-5c81c979-35ce-4aca-85c1-8fd21e3a27f6 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:25.012764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b563feff-fdce-4bd1-9ecd-54b450f34df4 req-5c81c979-35ce-4aca-85c1-8fd21e3a27f6 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:25.017946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b563feff-fdce-4bd1-9ecd-54b450f34df4 req-5c81c979-35ce-4aca-85c1-8fd21e3a27f6 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:25.025795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-b563feff-fdce-4bd1-9ecd-54b450f34df4 req-5c81c979-35ce-4aca-85c1-8fd21e3a27f6 service nova] Creating event network-vif-deleted:029a6b88-b666-4955-8888-cf641a23b712 for instance 2581e39c-49df-4aa0-8e61-4351d31907d8 on hv-cinder-85265 Aug 18 21:01:25.028709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:25.031616 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-b563feff-fdce-4bd1-9ecd-54b450f34df4 req-5c81c979-35ce-4aca-85c1-8fd21e3a27f6 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034416 Aug 18 21:01:25.032402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 402/810] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:01:25.040946 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f7b399c8-3934-4157-99a7-3488a12d6a13 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.258425 Aug 18 21:01:25.041724 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 409/811] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:24 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:01:25.654549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-397d099b-71e0-4606-acb5-b7269b781a61 req-1792a4b4-a5ec-46b5-96a4-157b5220b749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36afd51b-5953-4414-8efe-b33c3e8a2fda", "name": "network-vif-plugged", "status": "completed", "tag": "febcfc1a-0d17-4c46-ba69-4e78e95c42a3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:01:25.667344 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-397d099b-71e0-4606-acb5-b7269b781a61 req-1792a4b4-a5ec-46b5-96a4-157b5220b749 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:25.668193 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-397d099b-71e0-4606-acb5-b7269b781a61 req-1792a4b4-a5ec-46b5-96a4-157b5220b749 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:25.668625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-397d099b-71e0-4606-acb5-b7269b781a61 req-1792a4b4-a5ec-46b5-96a4-157b5220b749 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:25.679801 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-397d099b-71e0-4606-acb5-b7269b781a61 req-1792a4b4-a5ec-46b5-96a4-157b5220b749 service nova] Creating event network-vif-plugged:febcfc1a-0d17-4c46-ba69-4e78e95c42a3 for instance 36afd51b-5953-4414-8efe-b33c3e8a2fda on hv-cinder-85265 Aug 18 21:01:25.684954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-397d099b-71e0-4606-acb5-b7269b781a61 req-1792a4b4-a5ec-46b5-96a4-157b5220b749 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036489 Aug 18 21:01:25.685761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 403/812] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:01:25.839072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:25.839846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:25.847508 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:25.848130 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:25.848668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:25.849666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:25.850154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:25.850879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:25.884772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:25.885298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:25.885708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:25.886216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lazy-loading 'fault' on Instance uuid 2581e39c-49df-4aa0-8e61-4351d31907d8 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:01:25.929023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd87dd0b10a4a4db39935df509bc8eb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed3d374c7a145918d9ad3b770cb562b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:25.936875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-83e056bb-9cd3-4d8d-8031-07705c2b9273 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 200 len: 1348 microversion: 2.1 time: 0.103275 Aug 18 21:01:25.937451 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 410/813] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:25 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:26.064102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:26.064808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:26.071741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:26.072227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:26.072664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:26.073360 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:26.073815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:26.074235 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:26.215708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:26.223823 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4dbfd334-b263-4a88-bd98-402cc8089a1f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.163812 Aug 18 21:01:26.224484 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 404/814] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:26 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:26.958776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:26.959456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] [instance: 2581e39c-49df-4aa0-8e61-4351d31907d8] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:26.966137 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:26.966621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:26.967086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:26.967809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:26.968259 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:26.968688 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:26.984633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] HTTP exception thrown: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 could not be found. Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Request method failure captured: Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 HTTP/1.1 Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qejMBaYj0bWrNRmkc4hO9vAYm0g_P71wZWCXG-tcErySQYGU-RHGncH3_vu7ZVxxfXOin01j4QthAg0k7pnAS52EMMxDAGw8Ley5ox8Ms4MTsGDJQOx3jGVd4z5rOrB-2eRNJaq1Ognp-co7h5eEQFGSOt6eLcQm46gHs3kVYDGke4 Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 3ed3d374c7a145918d9ad3b770cb562b Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-TestMinimumBasicScenario-1563995049 Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:01:26.986254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/3ed3d374c7a145918d9ad3b770cb562b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-TestMinimumBasicScenario-1563995049 Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 3ed3d374c7a145918d9ad3b770cb562b Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1563995049 Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-TestMinimumBasicScenario-1563995049-project Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: d87dd0b10a4a4db39935df509bc8eb0b Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-TestMinimumBasicScenario-1563995049-project Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 could not be found. Aug 18 21:01:26.987942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '2581e39c-49df-4aa0-8e61-4351d31907d8'} Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 could not be found. Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:01:26.988978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 could not be found. Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 could not be found. Aug 18 21:01:26.990594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:01:26.991944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Returning 404 to user: Instance 2581e39c-49df-4aa0-8e61-4351d31907d8 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:01:26.991944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7baa7a1e-09c2-40c4-935e-85b5477409fc tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8" status: 404 len: 111 microversion: 2.1 time: 0.032770 Aug 18 21:01:26.991944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 411/815] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:26 2022] GET /compute/v2.1/servers/2581e39c-49df-4aa0-8e61-4351d31907d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:01:26.996470 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-793c0d52-d343-4e2a-a34d-06a9f9fbb9a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] Calling method '.version_select at 0x7f8b5a290670>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:27.169491 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-793c0d52-d343-4e2a-a34d-06a9f9fbb9a5 tempest-TestMinimumBasicScenario-1563995049 tempest-TestMinimumBasicScenario-1563995049-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1618294974" status: 202 len: 0 microversion: 2.1 time: 0.176726 Aug 18 21:01:27.170122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 405/816] 10.222.0.62 () {58 vars in 1272 bytes} [Thu Aug 18 21:01:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1618294974 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:01:27.244740 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:27.245344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:27.251184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:27.251692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:27.252118 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:27.252797 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:27.253244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:27.253662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:27.395674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:27.404105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bcdc1bf7-5bac-40bc-bd77-09063a4d1ccb tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1575 microversion: 2.1 time: 0.163036 Aug 18 21:01:27.404799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 412/817] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:27 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:28.432025 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:28.432664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:28.439166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:28.439704 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:28.440107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:28.440794 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:28.441244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:28.441667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:28.577824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:01:28.585860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-78af4fa0-5977-42cf-8b77-356bbd6ecada tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1562 microversion: 2.1 time: 0.158734 Aug 18 21:01:28.586425 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 406/818] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:01:28 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:01:56.913766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:01:56.914998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:01:56.917343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.918078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.922847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:56.928067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:56.928067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:56.928067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:01:56.928067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:01:56.928441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:01:56.949766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ab046560-a207-4deb-be4f-e5d03451cd9b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/ips" status: 200 len: 150 microversion: 2.1 time: 0.039988 Aug 18 21:01:56.957043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 413/819] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 21:01:56 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:00.713886 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71da074-b0e6-412d-87c1-90ec9a30daa2"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:00.716215 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:00.718605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.719266 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=34 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:00.724006 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:00.724483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:00.724953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:00.725720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:00.726129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:00.726576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:04.062836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-af38a1b4-ba87-4ba7-ae06-09310975cd5e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.353354 Aug 18 21:02:04.063588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 407/820] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:02:00 2022] POST /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments => generated 194 bytes in 3355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:12.661061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71da074-b0e6-412d-87c1-90ec9a30daa2"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:12.663501 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:12.672233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:12.672726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:12.673168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:12.673884 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:12.674375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:12.674902 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:12.759033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Invalid volume: volume d71da074-b0e6-412d-87c1-90ec9a30daa2 is already attached to instances: 64ec55a1-210c-4113-8e6b-26a08a596519 Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: POST /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments HTTP/1.1 Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 74 Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:02:12.760700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {"volumeAttachment": {"volumeId": "d71da074-b0e6-412d-87c1-90ec9a30daa2"}} Aug 18 21:02:12.762389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Invalid volume: volume d71da074-b0e6-412d-87c1-90ec9a30daa2 is already attached to instances: 64ec55a1-210c-4113-8e6b-26a08a596519 Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'server_id': '64ec55a1-210c-4113-8e6b-26a08a596519', 'body': {'volumeAttachment': {'volumeId': 'd71da074-b0e6-412d-87c1-90ec9a30daa2'}}} Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d71da074-b0e6-412d-87c1-90ec9a30daa2 is already attached to instances: 64ec55a1-210c-4113-8e6b-26a08a596519 Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:12.763473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d71da074-b0e6-412d-87c1-90ec9a30daa2 is already attached to instances: 64ec55a1-210c-4113-8e6b-26a08a596519 Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:02:12.764971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d71da074-b0e6-412d-87c1-90ec9a30daa2 is already attached to instances: 64ec55a1-210c-4113-8e6b-26a08a596519 Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 400 to user: Invalid volume: volume d71da074-b0e6-412d-87c1-90ec9a30daa2 is already attached to instances: 64ec55a1-210c-4113-8e6b-26a08a596519 {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e1f62ae9-a6b1-4050-b924-81b85ff3673c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105437 Aug 18 21:02:12.766341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 414/821] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:02:12 2022] POST /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 21:02:12.836527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:12.840939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:12.841552 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:12.847794 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:12.848355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:12.848788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:12.849483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:12.849937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:12.850363 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:12.936326 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lazy-loading 'services' on Instance uuid 64ec55a1-210c-4113-8e6b-26a08a596519 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:02:13.139220 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8cc82755-8199-4587-adf5-2d46bfd0e1fd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments/d71da074-b0e6-412d-87c1-90ec9a30daa2" status: 202 len: 0 microversion: 2.1 time: 0.304455 Aug 18 21:02:13.139797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 408/822] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:02:12 2022] DELETE /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments/d71da074-b0e6-412d-87c1-90ec9a30daa2 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:02:13.151798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:13.152638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:13.159883 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:13.160370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:13.160810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:13.161510 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:13.161963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:13.162388 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:13.208978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a20b33f0-10cd-4507-af0a-1d98200f9986 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057823 Aug 18 21:02:13.208978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 415/823] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:02:13 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:14.220779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:14.223112 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:14.230204 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:14.230700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:14.231139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:14.231882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:14.232335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:14.232762 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:14.270392 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-922177ff-65b7-429f-a562-0b4156611eca tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053968 Aug 18 21:02:14.270964 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 409/824] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:02:14 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:15.285880 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:15.288151 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:15.294881 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:15.295390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:15.295914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:15.296638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:15.297096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:15.297526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:15.330659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9a0d7331-da8e-480a-b6a4-c538590abed9 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049694 Aug 18 21:02:15.331239 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 416/825] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:02:15 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 21:02:15.393746 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:15.394242 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:15.401247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:15.401733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:15.402168 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:15.402868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:15.403320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:15.403765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:15.431695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Going to try to terminate instance {{(pid=127937) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:02:15.728798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4fb3508b-7524-43c7-be51-9798af6a7ba0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 204 len: 0 microversion: 2.1 time: 0.338569 Aug 18 21:02:15.729327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 410/826] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:02:15 2022] DELETE /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:02:15.737479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:15.738097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:15.744485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:15.744975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:15.745415 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:15.746108 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:15.746565 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:15.746992 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:15.879830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:15.888282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c7bab382-407d-48b6-9a43-c9c75d4f9700 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1680 microversion: 2.1 time: 0.154622 Aug 18 21:02:15.888858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 417/827] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:15 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:02:16.910414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:16.911565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:16.919413 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:16.919903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:16.920336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:16.921048 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:16.921707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:16.922137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:17.219596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:17.227443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-819063c3-9d2f-493d-a90c-73f86a666282 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1680 microversion: 2.1 time: 0.321747 Aug 18 21:02:17.228014 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 411/828] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:16 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1680 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:18.248920 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:18.249540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:18.255971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:18.256458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:18.256895 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:18.257588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:18.258040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:18.258466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:18.387419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:18.395182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-15578a11-b42f-4c0c-914d-07b401528acd tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1680 microversion: 2.1 time: 0.150216 Aug 18 21:02:18.395782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 418/829] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:18 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:19.416523 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:19.417049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:19.423674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:19.429232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:19.429232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:19.429232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:19.429232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:19.429679 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:19.567454 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:19.575777 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3ef1c8f4-a20c-48b5-a4c3-ae77639e350e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1680 microversion: 2.1 time: 0.163670 Aug 18 21:02:19.576368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 412/830] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:19 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:20.596770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:20.597382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:20.610117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:20.610539 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:20.610970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:20.611769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:20.612219 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:20.612675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:20.746477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:20.754156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d7becc5d-0401-41bc-8672-8f7d26b2b310 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1680 microversion: 2.1 time: 0.161296 Aug 18 21:02:20.758706 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 419/831] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:20 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:21.777343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:21.777968 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:21.785187 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:21.785681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:21.786121 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:21.786835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:21.787294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:21.787748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:21.853200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:21.861795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0395aea4-ba07-433f-ab3c-9e5ebfe02a2d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1614 microversion: 2.1 time: 0.088849 Aug 18 21:02:21.862376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 413/832] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:21 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:22.148496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-e1649c4d-efc2-428d-a140-449b6425c126 req-cdc2eb34-9fcc-4040-ad5d-449b01c4a59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64ec55a1-210c-4113-8e6b-26a08a596519", "name": "network-vif-deleted", "tag": "c8f61743-94fb-4639-9208-0b62c215c0cb"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:22.158427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e1649c4d-efc2-428d-a140-449b6425c126 req-cdc2eb34-9fcc-4040-ad5d-449b01c4a59d service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:22.158841 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e1649c4d-efc2-428d-a140-449b6425c126 req-cdc2eb34-9fcc-4040-ad5d-449b01c4a59d service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:22.159319 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e1649c4d-efc2-428d-a140-449b6425c126 req-cdc2eb34-9fcc-4040-ad5d-449b01c4a59d service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:22.172356 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-e1649c4d-efc2-428d-a140-449b6425c126 req-cdc2eb34-9fcc-4040-ad5d-449b01c4a59d service nova] Creating event network-vif-deleted:c8f61743-94fb-4639-9208-0b62c215c0cb for instance 64ec55a1-210c-4113-8e6b-26a08a596519 on hv-cinder-85265 Aug 18 21:02:22.177362 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-e1649c4d-efc2-428d-a140-449b6425c126 req-cdc2eb34-9fcc-4040-ad5d-449b01c4a59d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033119 Aug 18 21:02:22.177944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 420/833] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:22.883867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:22.884483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:22.891282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:22.892565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:22.892565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:22.892962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:22.893420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:22.893846 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:22.929531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:22.930546 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:22.930985 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:22.931758 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lazy-loading 'fault' on Instance uuid 64ec55a1-210c-4113-8e6b-26a08a596519 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:02:22.984619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:22.989474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-77c12fb4-5678-4122-94e7-7ed1eed125da tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 200 len: 1331 microversion: 2.1 time: 0.109378 Aug 18 21:02:22.999169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 414/834] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:22 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:02:24.013348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:24.014047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:24.020283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:24.020765 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:24.021199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:24.021887 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:24.022340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:24.022965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:24.036985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 HTTP/1.1 Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:02:24.038672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:02:24.040436 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '64ec55a1-210c-4113-8e6b-26a08a596519'} Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:02:24.041403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:02:24.042737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:02:24.044266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:02:24.044266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-717732ed-89bb-46f7-8910-e893765be987 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 404 len: 111 microversion: 2.1 time: 0.032353 Aug 18 21:02:24.044266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 421/835] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:24 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:02:24.049046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2df45ba1-99d0-457e-9423-fa5aff42b920 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '.version_select at 0x7f8b5a4aec10>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:24.197303 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2df45ba1-99d0-457e-9423-fa5aff42b920 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-705666666" status: 202 len: 0 microversion: 2.1 time: 0.151962 Aug 18 21:02:24.197887 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 415/836] 10.222.0.62 () {58 vars in 1218 bytes} [Thu Aug 18 21:02:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-705666666 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:02:25.076295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-625d57d2-5967-4ba9-8881-277a52a50d3e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: .version_select at 0x7f8b5a228430>, body: {"keypair": {"name": "tempest-keypair-1920481492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/BiWkTMLpPhAI8w4mB/nefKm6MWHBg8ESZ+6+5mucd3d/nEqPblkpm18E5qbcylkDq6RU9GGw+iyZPiPnbxpVmNYzrlc1Dt77prr8lVQ6xPZ3OYyK/Ee1ttRi917FDjw=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:25.092661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-625d57d2-5967-4ba9-8881-277a52a50d3e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:02:25.096406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-625d57d2-5967-4ba9-8881-277a52a50d3e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:02:25.198855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-625d57d2-5967-4ba9-8881-277a52a50d3e tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126409 Aug 18 21:02:25.199584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 422/837] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 21:02:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:27.784324 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-533880023", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1c5039fe-c5ac-448f-a973-5b4f5015467c"}], "security_groups": [{"name": "tempest-securitygroup--1694499548"}], "key_name": "tempest-keypair-1920481492", "user_data": "}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:27.889762 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] validate_networks() for [('1c5039fe-c5ac-448f-a973-5b4f5015467c', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:02:28.266603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:02:28.266982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:02:28.267507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:02:28.267953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:02:28.268453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:02:28.277882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:28.278408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:28.278869 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:28.279661 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:28.280098 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:28.280527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:28.298669 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:02:28.302761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Getting quotas for user b5b5dd3c92034837921826c9b2dea76b and project abf631fcae584ce1a0b8c26560398cea. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:02:28.313853 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:02:28.316165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:02:28.473048 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e3e27d63-41b8-42f3-93a0-5aecceb9f3d6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.693896 Aug 18 21:02:28.473690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 416/838] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:02:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:02:28.485696 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3192a225-76be-47f9-a9d0-17897a04ab38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:28.486299 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3192a225-76be-47f9-a9d0-17897a04ab38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:28.544025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3192a225-76be-47f9-a9d0-17897a04ab38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:28.552079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3192a225-76be-47f9-a9d0-17897a04ab38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1241 microversion: 2.1 time: 0.070908 Aug 18 21:02:28.553442 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 423/839] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:28 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:02:29.582674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:29.582674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:29.587850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:29.588543 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:29.588980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:29.589758 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:29.590339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:29.590772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:29.674934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:29.684684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d1182286-2259-4bec-80e0-6916f3dc883b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1245 microversion: 2.1 time: 0.110106 Aug 18 21:02:29.685255 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 417/840] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:29 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1245 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:30.705500 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:30.706115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:30.712621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:30.713105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:30.713546 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:30.714273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:30.714723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:30.715155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:30.777393 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:30.785291 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ded7b6f0-de76-4cb6-8cb9-a1af508bf0d3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1293 microversion: 2.1 time: 0.083799 Aug 18 21:02:30.786110 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 424/841] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:30 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:31.806288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:31.807790 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:31.814584 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:31.815595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:31.815772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:31.816497 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:31.816979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:31.817410 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:31.820420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:31.955312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:31.963743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4e9f5924-e21b-42bc-b86d-cecf79a0abed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.161164 Aug 18 21:02:31.964314 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 418/842] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:31 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:32.714939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-70d9469a-ec98-431b-9fef-68f7c95dfed4 req-9b397d50-6938-4d68-8acc-37bb6dbb6121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b369215c-2bbc-48a0-83e2-67f84e76f9ca", "tag": "b374dc73-9026-428c-860c-1a23cc6ffac3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:32.724701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-70d9469a-ec98-431b-9fef-68f7c95dfed4 req-9b397d50-6938-4d68-8acc-37bb6dbb6121 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:32.725162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-70d9469a-ec98-431b-9fef-68f7c95dfed4 req-9b397d50-6938-4d68-8acc-37bb6dbb6121 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:32.725594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-70d9469a-ec98-431b-9fef-68f7c95dfed4 req-9b397d50-6938-4d68-8acc-37bb6dbb6121 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:32.736283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-70d9469a-ec98-431b-9fef-68f7c95dfed4 req-9b397d50-6938-4d68-8acc-37bb6dbb6121 service nova] Creating event network-changed:b374dc73-9026-428c-860c-1a23cc6ffac3 for instance b369215c-2bbc-48a0-83e2-67f84e76f9ca on hv-cinder-85265 Aug 18 21:02:32.741145 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-70d9469a-ec98-431b-9fef-68f7c95dfed4 req-9b397d50-6938-4d68-8acc-37bb6dbb6121 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030516 Aug 18 21:02:32.741727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 425/843] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:32.984209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:32.984827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:32.992658 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:32.993542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:32.993991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:32.995226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:32.995705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:32.996133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:33.166991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:33.175997 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9f49e5eb-af58-4eae-b9fe-82b3aa424aeb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.195287 Aug 18 21:02:33.176453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 419/844] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:32 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:34.197501 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:34.198264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:34.206884 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:34.207383 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:34.207834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:34.208527 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:34.209009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:34.209438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:34.355508 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:34.363325 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-717c6ae6-af29-445c-be25-1c8356c74937 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.170629 Aug 18 21:02:34.363924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 426/845] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:34 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:35.385158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:35.385766 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:35.391803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:35.392285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:35.392750 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:35.393447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:35.393930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:35.394355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:35.530870 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:35.538979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2a5776f9-bc6a-46df-b412-f940e3958745 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.157856 Aug 18 21:02:35.539559 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 420/846] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:35 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:36.561544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:36.561544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:36.567344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:36.567855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:36.568286 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:36.569086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:36.569538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:36.569951 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:36.705485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:36.713046 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a46cc977-360c-4758-b871-99c3f7ccf6ed tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.157432 Aug 18 21:02:36.713606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 427/847] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:36 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:37.737844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:37.738752 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:37.746250 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:37.746753 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:37.747189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:37.747965 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:37.748427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:37.748852 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:37.887776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:37.895656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e3399216-0631-4c54-93b1-df48dcda1bfc tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.164352 Aug 18 21:02:37.896214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 421/848] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:37 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:38.918048 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:38.918657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:38.921106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=6 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:38.925905 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:38.926411 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:38.926838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:38.927557 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:38.928002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:38.928422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:39.061132 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:39.068807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-225be4ba-7e64-4438-ab59-58b66a8370f4 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.154546 Aug 18 21:02:39.069375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 428/849] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:38 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:39.936368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-ee47775b-33ff-4f8b-a77c-4c9eaa3e4118 req-5bc9f94d-ff84-46ba-9b29-b76a4238b645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b369215c-2bbc-48a0-83e2-67f84e76f9ca", "name": "network-vif-plugged", "status": "completed", "tag": "b374dc73-9026-428c-860c-1a23cc6ffac3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:39.942687 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:39.943506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:39.948009 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-ee47775b-33ff-4f8b-a77c-4c9eaa3e4118 req-5bc9f94d-ff84-46ba-9b29-b76a4238b645 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:39.948480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-ee47775b-33ff-4f8b-a77c-4c9eaa3e4118 req-5bc9f94d-ff84-46ba-9b29-b76a4238b645 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:39.948905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-ee47775b-33ff-4f8b-a77c-4c9eaa3e4118 req-5bc9f94d-ff84-46ba-9b29-b76a4238b645 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:39.960234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-ee47775b-33ff-4f8b-a77c-4c9eaa3e4118 req-5bc9f94d-ff84-46ba-9b29-b76a4238b645 service nova] Creating event network-vif-plugged:b374dc73-9026-428c-860c-1a23cc6ffac3 for instance b369215c-2bbc-48a0-83e2-67f84e76f9ca on hv-cinder-85265 Aug 18 21:02:39.965817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-ee47775b-33ff-4f8b-a77c-4c9eaa3e4118 req-5bc9f94d-ff84-46ba-9b29-b76a4238b645 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033500 Aug 18 21:02:39.968072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 422/850] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:40.093177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:40.093796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:40.100746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:40.101234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:40.101672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:40.102440 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:40.102897 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:40.103321 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:40.237463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:40.245469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6b7ebd6e-129f-408b-8e25-3efa0307a127 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.156284 Aug 18 21:02:40.247704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 429/851] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:40 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:41.267119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:41.267920 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:41.274745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:41.275223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:41.276191 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:41.279218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:41.279218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:41.279218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:41.423539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:41.431282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-028f7cae-1642-4a30-bbb3-943ddc16ff4f tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1367 microversion: 2.1 time: 0.169689 Aug 18 21:02:41.431935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 423/852] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:41 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:42.452668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:42.453224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:42.459678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:42.460157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:42.460586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:42.461341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:42.461807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:42.462250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:42.596927 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:42.604553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0a36fbcd-6638-4178-b7b0-a4cd726ea1e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1558 microversion: 2.1 time: 0.155803 Aug 18 21:02:42.612961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 430/853] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:42 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:42.627516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:42.628041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:42.634861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:42.635423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:42.635866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:42.636579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:42.637582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:42.638011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:42.767094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-adeebbbc-cc5f-4028-a4a3-03e40500cceb tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143364 Aug 18 21:02:42.767785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 424/854] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 21:02:42 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:43.905684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-2c85451a-f773-4390-9ebc-361d5049b847 req-c4b1328c-4b64-480e-9f78-1b8c14440203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b369215c-2bbc-48a0-83e2-67f84e76f9ca", "tag": "b374dc73-9026-428c-860c-1a23cc6ffac3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:43.912141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:43.915925 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-2c85451a-f773-4390-9ebc-361d5049b847 req-c4b1328c-4b64-480e-9f78-1b8c14440203 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:43.916955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-2c85451a-f773-4390-9ebc-361d5049b847 req-c4b1328c-4b64-480e-9f78-1b8c14440203 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:43.917381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-2c85451a-f773-4390-9ebc-361d5049b847 req-c4b1328c-4b64-480e-9f78-1b8c14440203 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:43.929027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-2c85451a-f773-4390-9ebc-361d5049b847 req-c4b1328c-4b64-480e-9f78-1b8c14440203 service nova] Creating event network-changed:b374dc73-9026-428c-860c-1a23cc6ffac3 for instance b369215c-2bbc-48a0-83e2-67f84e76f9ca on hv-cinder-85265 Aug 18 21:02:43.951506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-2c85451a-f773-4390-9ebc-361d5049b847 req-c4b1328c-4b64-480e-9f78-1b8c14440203 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033721 Aug 18 21:02:43.951506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 431/855] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:47.284288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-780774856", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "networks": [{"uuid": "faea3805-0328-4f50-b316-efa144d72b4b"}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:47.292257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:47.336897 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] validate_networks() for [('faea3805-0328-4f50-b316-efa144d72b4b', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:02:47.688561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:02:47.688982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:02:47.689472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:02:47.689859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:02:47.690263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:02:47.698979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:47.699562 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:47.700103 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:47.700861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:47.701432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:47.701992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:47.718784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Getting quotas for project 32366eaaa6d342adb39c9175a121324a. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:02:47.722732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Getting quotas for user d1b36de9654d42a685c96ec7ea6608f3 and project 32366eaaa6d342adb39c9175a121324a. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:02:47.734429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:02:47.736717 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:02:47.889711 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8ed58a7a-80fe-4bab-8dae-b315c69f81e3 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609997 Aug 18 21:02:47.890396 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 425/856] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:02:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 21:02:47.906929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-57955a62-a939-45d0-ab20-958aebb8e66e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:47.907653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-57955a62-a939-45d0-ab20-958aebb8e66e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:47.974567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-57955a62-a939-45d0-ab20-958aebb8e66e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:47.978162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-57955a62-a939-45d0-ab20-958aebb8e66e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1213 microversion: 2.1 time: 0.076125 Aug 18 21:02:47.979237 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 432/857] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:47 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:48.999008 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4d52381e-af0d-42a6-8b18-92796a1d7b2d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:48.999662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4d52381e-af0d-42a6-8b18-92796a1d7b2d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:49.053468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4d52381e-af0d-42a6-8b18-92796a1d7b2d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:49.060466 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4d52381e-af0d-42a6-8b18-92796a1d7b2d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1213 microversion: 2.1 time: 0.065655 Aug 18 21:02:49.061025 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 426/858] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:48 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:50.080995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:50.081620 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:50.088733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:50.093775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:50.093775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:50.093775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:50.093775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:50.094165 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:50.094289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=85 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:50.153543 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:50.161478 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a1b6eec6-9432-469f-b102-2a1581da7079 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1265 microversion: 2.1 time: 0.084339 Aug 18 21:02:50.162034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 433/859] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:50 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:51.182184 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:51.182805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:51.190161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:51.190648 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:51.191084 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:51.191851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:51.192356 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:51.192748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:51.257512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:51.266859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-330393c8-38f7-46d2-992a-7daf1e2ff15c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1271 microversion: 2.1 time: 0.088293 Aug 18 21:02:51.267691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 427/860] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:51 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:52.290454 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:52.291553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:52.301146 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:52.301739 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:52.302105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:52.302809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:52.303266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:52.303721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:52.318125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-f67a8907-4519-4890-a443-c67b7b7093b6 req-3f3edd1e-2295-4181-a52f-5f22db432f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11326c40-5856-43f3-a021-e8d4c0f6c2b1", "tag": "b7e96ebb-04c8-4e7f-8fe0-a9b4ee33596c"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:02:52.331336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f67a8907-4519-4890-a443-c67b7b7093b6 req-3f3edd1e-2295-4181-a52f-5f22db432f83 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:52.332284 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f67a8907-4519-4890-a443-c67b7b7093b6 req-3f3edd1e-2295-4181-a52f-5f22db432f83 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:52.332863 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f67a8907-4519-4890-a443-c67b7b7093b6 req-3f3edd1e-2295-4181-a52f-5f22db432f83 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:52.348977 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-f67a8907-4519-4890-a443-c67b7b7093b6 req-3f3edd1e-2295-4181-a52f-5f22db432f83 service nova] Creating event network-changed:b7e96ebb-04c8-4e7f-8fe0-a9b4ee33596c for instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 on hv-cinder-85265 Aug 18 21:02:52.354785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-f67a8907-4519-4890-a443-c67b7b7093b6 req-3f3edd1e-2295-4181-a52f-5f22db432f83 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042937 Aug 18 21:02:52.356516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 428/861] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:02:52.544967 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:52.552645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4f8f673c-c80f-4929-8a0d-15ef1418441b tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.266422 Aug 18 21:02:52.553451 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 434/862] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:52 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:53.573684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:53.574387 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:53.581096 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:53.581578 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:53.582013 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:53.582736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:53.583192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:53.583645 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:53.717751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:53.725320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a2f2e711-f74a-4d6d-912f-1a583d2bc684 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.156333 Aug 18 21:02:53.726050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 429/863] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:53 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:54.745100 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:54.745670 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:54.752627 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:54.753103 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:54.753562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:54.754248 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:54.754694 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:54.755114 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:54.888861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:54.896465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8b5336a5-5488-4f60-b4a9-1938e0f9f883 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.155326 Aug 18 21:02:54.897024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 435/864] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:54 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:55.917298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:55.917916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:55.925550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:55.926030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:55.926477 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:55.927168 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:55.927649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:55.928077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:56.061427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:56.069646 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1953605d-253f-4214-ba0a-f702667e7b24 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.156258 Aug 18 21:02:56.070201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 430/865] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:55 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:57.090930 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:57.091572 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:57.098732 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:57.099218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:57.099686 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:57.100505 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:57.100962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:57.101388 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:57.234891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:57.242474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a81ee09c-0b08-45e3-aec1-0ecfcf36fb1d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.155390 Aug 18 21:02:57.243104 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 436/866] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:57 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:58.263156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:58.263880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:58.266232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:58.271127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:58.276936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:58.276936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:58.276936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:58.276936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:58.277320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:58.406577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:58.415212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b9db18e0-4dc3-45bf-b1ed-fd2ed441c7e1 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.155882 Aug 18 21:02:58.417210 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 431/867] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:58 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:02:59.435235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:02:59.435825 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:02:59.437713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:59.443647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:59.448885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:59.448885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:59.448885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:02:59.448885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:02:59.449254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:02:59.727523 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:02:59.735069 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5c036630-4e1d-48df-8805-918a1d33c763 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.303827 Aug 18 21:02:59.736285 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 437/868] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:02:59 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:00.007899 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-5313fba3-f650-4507-8a42-341584acb656 req-d92d929d-b785-4769-80f7-b9eaf7cab0bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11326c40-5856-43f3-a021-e8d4c0f6c2b1", "name": "network-vif-plugged", "status": "completed", "tag": "b7e96ebb-04c8-4e7f-8fe0-a9b4ee33596c"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:00.013104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=8 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:00.019497 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5313fba3-f650-4507-8a42-341584acb656 req-d92d929d-b785-4769-80f7-b9eaf7cab0bf service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:00.019980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5313fba3-f650-4507-8a42-341584acb656 req-d92d929d-b785-4769-80f7-b9eaf7cab0bf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:00.020414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5313fba3-f650-4507-8a42-341584acb656 req-d92d929d-b785-4769-80f7-b9eaf7cab0bf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:00.032086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-5313fba3-f650-4507-8a42-341584acb656 req-d92d929d-b785-4769-80f7-b9eaf7cab0bf service nova] Creating event network-vif-plugged:b7e96ebb-04c8-4e7f-8fe0-a9b4ee33596c for instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 on hv-cinder-85265 Aug 18 21:03:00.037919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-5313fba3-f650-4507-8a42-341584acb656 req-d92d929d-b785-4769-80f7-b9eaf7cab0bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033846 Aug 18 21:03:00.038527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 432/869] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:03:00.756942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:00.757560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:00.764449 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:00.764951 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:00.765389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:00.766110 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:00.766570 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:00.766999 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:00.903387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:00.911531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b6bf9dd5-0fbd-4c10-abee-ea9efccc9857 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.158408 Aug 18 21:03:00.914820 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 438/870] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:00 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:01.934973 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:01.935689 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:01.942767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:01.943386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:01.943828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:01.944537 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:01.945031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:01.945490 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:02.076362 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:02.084502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d0a7cd4d-a8ab-453d-9152-82a4bcce3c6d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1313 microversion: 2.1 time: 0.154593 Aug 18 21:03:02.085158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 433/871] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:01 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:03.105302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:03.105911 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:03.113104 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:03.113584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:03.114084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:03.114783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:03.115241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:03.115707 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:03.244890 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:03.252689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cdc6dc77-9e67-4df8-89dd-fb2ccf5382c5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1496 microversion: 2.1 time: 0.151227 Aug 18 21:03:03.253919 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 439/872] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:03 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1496 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:03.458077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:03.458653 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:03.465205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:03.465687 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:03.466119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:03.466814 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:03.467264 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:03.467712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:03.470149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=72 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:03.494746 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-bfb83c56-caac-42fd-b91b-05c21df232cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/ips" status: 200 len: 153 microversion: 2.20 time: 0.040666 Aug 18 21:03:03.498576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 434/873] 10.222.0.62 () {60 vars in 1289 bytes} [Thu Aug 18 21:03:03 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:03:04.209336 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:04.211866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:04.216229 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:04.216719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:04.217161 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:04.217867 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:04.218318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:04.218854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:04.243734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:03:04.652814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-31ddabd2-bf09-48ba-8957-9bd90c1ce8e7 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "DELETE /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 204 len: 0 microversion: 2.1 time: 0.447853 Aug 18 21:03:04.653402 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 440/874] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:03:04 2022] DELETE /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 21:03:04.661809 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:04.662476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:04.669119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:04.669598 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:04.670035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:04.670721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:04.671181 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:04.671629 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:04.806027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:04.807786 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8573d48a-64f7-4ef1-847e-da98e95bac8f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1502 microversion: 2.1 time: 0.149924 Aug 18 21:03:04.808352 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 435/875] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:04 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:05.709021 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:05.709644 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:05.716045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:05.716534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:05.716974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:05.717667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:05.718124 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:05.718552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:05.741074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lazy-loading 'flavor' on Instance uuid 93e18af4-e43d-4a3e-8927-934dd31062c1 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:03:05.828933 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:05.829647 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:05.836363 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:05.836867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:05.837284 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:05.838006 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:05.838435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:05.838909 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:05.972656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:05.980413 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-520cfbe7-65cd-482f-89c7-01c81bd1fded tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1502 microversion: 2.1 time: 0.155389 Aug 18 21:03:05.980978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 436/876] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:05 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:03:06.322359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1333e68a-c215-4f07-ad16-7f267ad8842c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/action" status: 202 len: 0 microversion: 2.20 time: 0.618062 Aug 18 21:03:06.322938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 441/877] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Aug 18 21:03:05 2022] POST /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:03:06.331062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:06.331709 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:06.337696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:06.338183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:06.338622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:06.339328 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:06.339810 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:06.340236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:06.471854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:06.480092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:06.481576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:06.482734 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6f1d70e6-0d94-4af1-95c8-694f7f57407e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.155547 Aug 18 21:03:06.483282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 437/878] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:06 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:07.002270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:07.003581 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:07.010560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:07.014725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:07.014725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:07.014725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:07.014725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:07.015088 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:07.136849 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-f5c622a1-a030-414d-b7cb-a3e16fc18bb6 req-86410209-302d-47fc-b26e-f61cab35551e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11326c40-5856-43f3-a021-e8d4c0f6c2b1", "name": "network-vif-deleted", "tag": "b7e96ebb-04c8-4e7f-8fe0-a9b4ee33596c"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:07.147200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f5c622a1-a030-414d-b7cb-a3e16fc18bb6 req-86410209-302d-47fc-b26e-f61cab35551e service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:07.147963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f5c622a1-a030-414d-b7cb-a3e16fc18bb6 req-86410209-302d-47fc-b26e-f61cab35551e service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:07.148390 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-f5c622a1-a030-414d-b7cb-a3e16fc18bb6 req-86410209-302d-47fc-b26e-f61cab35551e service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:07.160882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-f5c622a1-a030-414d-b7cb-a3e16fc18bb6 req-86410209-302d-47fc-b26e-f61cab35551e service nova] Creating event network-vif-deleted:b7e96ebb-04c8-4e7f-8fe0-a9b4ee33596c for instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 on hv-cinder-85265 Aug 18 21:03:07.165854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-f5c622a1-a030-414d-b7cb-a3e16fc18bb6 req-86410209-302d-47fc-b26e-f61cab35551e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032660 Aug 18 21:03:07.166446 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 438/879] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:03:07.221914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:07.230466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-186cc963-d59b-4bd5-befe-cec130d26075 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 200 len: 1460 microversion: 2.1 time: 0.232834 Aug 18 21:03:07.231027 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 442/880] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:06 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 1460 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:07.506612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:07.507316 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:07.513550 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:07.514039 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:07.514472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:07.515171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:07.515657 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:07.516086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:07.889966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:07.898233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:07.899765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:07.900938 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4d0d4050-fbae-4383-ac9a-99edb4f6d4ff tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.398620 Aug 18 21:03:07.901498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 439/881] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:07 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:08.252204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:08.256455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: 11326c40-5856-43f3-a021-e8d4c0f6c2b1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:08.260151 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:08.260639 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:08.261079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:08.261806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:08.262260 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:08.262780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:08.276280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] HTTP exception thrown: Instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 could not be found. Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Request method failure captured: Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 HTTP/1.1 Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qjz-KavqinWVg0br-i4FjDZQ_lFnalvyk_m2u2rLkFRlEaDwbwEXDZMNyMFsFvOnUbkr9eKjolOtu8m0zx0OJHNIp2wJBpFKUU-7jLqUUpL9rRWcOK6FGGnCy1BW26Qi94UyL6usKm_E4VbKeG-N63RkUScIEmMozibRDaMbFvrE5A Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 32366eaaa6d342adb39c9175a121324a Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesActionsTest-1069603505 Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:03:08.277913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_32366eaaa6d342adb39c9175a121324a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/32366eaaa6d342adb39c9175a121324a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/32366eaaa6d342adb39c9175a121324a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/32366eaaa6d342adb39c9175a121324a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesActionsTest-1069603505 Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 32366eaaa6d342adb39c9175a121324a Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesActionsTest-1069603505 Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesActionsTest-1069603505-project Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: d1b36de9654d42a685c96ec7ea6608f3 Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesActionsTest-1069603505-project Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 could not be found. Aug 18 21:03:08.279763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '11326c40-5856-43f3-a021-e8d4c0f6c2b1'} Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 could not be found. Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:03:08.280915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 could not be found. Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 could not be found. Aug 18 21:03:08.282469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:08.284240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Returning 404 to user: Instance 11326c40-5856-43f3-a021-e8d4c0f6c2b1 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:03:08.284240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4697e1ff-6a4c-4efe-90ef-6e162a90dd51 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1" status: 404 len: 111 microversion: 2.1 time: 0.031197 Aug 18 21:03:08.284240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 443/882] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:08 2022] GET /compute/v2.1/servers/11326c40-5856-43f3-a021-e8d4c0f6c2b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:03:08.330994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1709923831", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "networks": [{"uuid": "faea3805-0328-4f50-b316-efa144d72b4b"}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:08.384612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] validate_networks() for [('faea3805-0328-4f50-b316-efa144d72b4b', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:03:08.727950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:03:08.728372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:03:08.728834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:03:08.729265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:03:08.729670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:03:08.738918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:08.739414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:08.739843 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:08.740557 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:08.741006 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:08.741423 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:08.757885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Getting quotas for project 32366eaaa6d342adb39c9175a121324a. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:03:08.761865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Getting quotas for user d1b36de9654d42a685c96ec7ea6608f3 and project 32366eaaa6d342adb39c9175a121324a. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:03:08.772711 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:03:08.774963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:03:08.923915 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:08.924459 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-345c50e4-0bfe-4c7e-a3af-de88437f7b4f tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597150 Aug 18 21:03:08.924609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:08.925902 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 440/883] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:03:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:03:08.930986 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:08.931588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:08.932297 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:08.932714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:08.933321 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:08.933728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:08.937382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e5125c8f-abba-4b98-ac20-24e9a6b4a23c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:08.938248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e5125c8f-abba-4b98-ac20-24e9a6b4a23c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:08.994610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e5125c8f-abba-4b98-ac20-24e9a6b4a23c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:09.002974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e5125c8f-abba-4b98-ac20-24e9a6b4a23c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1214 microversion: 2.1 time: 0.070213 Aug 18 21:03:09.003569 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 441/884] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:08 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:03:09.079250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:09.088426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:09.089916 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:09.091066 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a3040d7e-7586-4e0f-ab7c-11c4f38686c1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.171296 Aug 18 21:03:09.091645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 444/885] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:08 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:03:10.023903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:10.025404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:10.030962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:10.031480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:10.031912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:10.032602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:10.033049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:10.033733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:10.098008 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:10.105841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6a93ab06-78e7-444e-a2d3-3e26ee9ca324 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1218 microversion: 2.1 time: 0.086069 Aug 18 21:03:10.106375 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 442/886] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:10 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:10.114604 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:10.115207 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:10.121846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:10.122305 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:10.122735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:10.123451 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:10.123899 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:10.124318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:10.255300 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:10.263850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:10.265359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:10.266526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a584a4b7-ca72-4b50-81ba-9f6d1ddf60e8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.156426 Aug 18 21:03:10.267076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 445/887] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:10 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:11.128720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:11.129444 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:11.135896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:11.136411 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:11.136915 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:11.137623 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:11.138071 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:11.138493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:11.208840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:11.216906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-548e40c9-4ffe-4c1a-8f7a-5b16efc084da tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1284 microversion: 2.1 time: 0.092290 Aug 18 21:03:11.217480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 443/888] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:11 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:11.290420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:11.291343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:11.298087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:11.298606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:11.299055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:11.300072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:11.300533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:11.300994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:11.509612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:11.520214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:11.520214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:11.521091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:11.522351 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-eaa582d2-712d-4906-8a09-5923b41c6f15 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.236016 Aug 18 21:03:11.523155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 446/889] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:11 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:12.238523 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:12.239220 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:12.245807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:12.246411 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:12.246946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:12.247751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:12.248280 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:12.248775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:12.376596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:12.385119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d3456ebd-8671-4496-9cbf-3d30a0e5f3b9 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.150535 Aug 18 21:03:12.385690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 444/890] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:12 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:12.546228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:12.546839 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:12.553579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:12.554067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:12.554500 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:12.555279 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:12.555684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:12.556225 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:12.685143 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:12.693914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:12.695453 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:12.696634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-682d3fd8-79a2-4399-a6bb-6b32ee3febee tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.155196 Aug 18 21:03:12.697443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 447/891] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:12 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:12.725209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-65b1bda1-2025-4e3e-bf12-248984e1d094 req-eb0be9f8-1809-4c2d-9b8c-9c6c4e071158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78119ea-1eab-499e-abbe-b576edefb5e3", "tag": "044e55a6-82c3-4dbe-83ac-6d2976f46c95"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:12.734708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-65b1bda1-2025-4e3e-bf12-248984e1d094 req-eb0be9f8-1809-4c2d-9b8c-9c6c4e071158 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:12.735102 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-65b1bda1-2025-4e3e-bf12-248984e1d094 req-eb0be9f8-1809-4c2d-9b8c-9c6c4e071158 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:12.735636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-65b1bda1-2025-4e3e-bf12-248984e1d094 req-eb0be9f8-1809-4c2d-9b8c-9c6c4e071158 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:12.747080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-65b1bda1-2025-4e3e-bf12-248984e1d094 req-eb0be9f8-1809-4c2d-9b8c-9c6c4e071158 service nova] Creating event network-changed:044e55a6-82c3-4dbe-83ac-6d2976f46c95 for instance c78119ea-1eab-499e-abbe-b576edefb5e3 on hv-cinder-85265 Aug 18 21:03:12.752057 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-65b1bda1-2025-4e3e-bf12-248984e1d094 req-eb0be9f8-1809-4c2d-9b8c-9c6c4e071158 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030972 Aug 18 21:03:12.752758 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 445/892] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:03:13.406730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:13.407348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:13.414886 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:13.415409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:13.415853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:13.416560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:13.417014 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:13.417444 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:13.552656 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:13.560891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cafbdb57-7183-41dc-8394-be964c81d244 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.158016 Aug 18 21:03:13.561447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 448/893] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:13 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:13.719953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:13.720630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:13.727295 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:13.727813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:13.728249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:13.728943 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:13.729398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:13.729825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:13.858169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:13.866821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:13.868333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:13.869483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3dce1b74-f575-49ab-919e-a626935af4b0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.154486 Aug 18 21:03:13.870116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 446/894] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:13 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:14.582728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:14.583335 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:14.589934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:14.590426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:14.590876 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:14.591639 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:14.592103 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:14.592541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:14.724269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:14.731930 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-28c82d9e-8efd-45a3-b7f9-9b2d202e5092 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.153658 Aug 18 21:03:14.732499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 449/895] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:14 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:14.891467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:14.891989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:14.898838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:14.899314 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:14.899771 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:14.900460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:14.900907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:14.901326 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:15.081037 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:15.089627 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:15.091129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:15.092316 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5223de1e-1f07-45ff-a3d2-1a8af10f0357 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.204863 Aug 18 21:03:15.092907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 447/896] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:14 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:15.753394 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:15.754668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:15.761412 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:15.761934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:15.762395 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:15.763136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:15.763648 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:15.764089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:15.896809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:15.904841 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6e8d2d65-d009-43d2-83b2-f9508d465aaf tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.155182 Aug 18 21:03:15.905415 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 450/897] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:15 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:16.116824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:16.117431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:16.124036 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:16.124590 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:16.125143 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:16.125795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:16.126221 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:16.126641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:16.257925 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:16.266189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:16.267711 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:16.268885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3a52cbfa-58e8-41ce-8813-b63b308b2aa5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.156794 Aug 18 21:03:16.269439 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 448/898] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:16 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:16.926264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:16.928280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:16.934057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:16.934545 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:16.934985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:16.935717 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:16.936175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:16.936697 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:17.071227 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:17.079112 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a60c6a35-8d2e-4de0-98cf-7f2200f8634e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.156750 Aug 18 21:03:17.079696 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 451/899] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:16 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:17.292627 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:17.293285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:17.299755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:17.300237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:17.300667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:17.301389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:17.301836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:17.302285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:17.435796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:17.444437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:17.445925 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:17.447087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c461f6fc-63be-4115-a9bc-623aee0182e1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.158514 Aug 18 21:03:17.447707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 449/900] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:17 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:18.099402 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:18.100544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:18.102810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:18.107536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:18.108032 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:18.108472 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:18.109166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:18.109624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:18.110055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:18.243980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:18.251852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2ecef062-2b75-4591-a863-f1e14d6a116c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.156421 Aug 18 21:03:18.252407 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 452/901] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:18 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:18.470336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:18.470947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:18.473374 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:18.478372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:18.478861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:18.479298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:18.480178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:18.480656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:18.481082 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:18.617455 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:18.626072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:18.627600 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:18.628783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-927fbd8b-371d-4871-b2f7-0b4f407cb01c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1746 microversion: 2.20 time: 0.162385 Aug 18 21:03:18.629344 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 450/902] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:18 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:19.273044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:19.273688 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:19.280119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:19.280638 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:19.281080 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:19.281787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:19.282244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:19.282676 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:19.513295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:19.522049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-fe64dddd-f62a-4a30-ad7c-015a10193c9d tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.252501 Aug 18 21:03:19.523455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 453/903] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:19 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:19.653428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:19.660780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:19.660780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:19.660780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=8 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:19.664121 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:19.664619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:19.665055 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:19.665756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:19.666212 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:19.666636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:19.806547 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:19.815130 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:19.816805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:19.817918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-986965a1-0ac8-4fac-ac53-fcee69f5c33c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1746 microversion: 2.20 time: 0.168453 Aug 18 21:03:19.819237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 451/904] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:19 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:20.212099 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-3f4a14c3-8307-4e2c-856e-faf700e115db req-8ab405b3-a1b5-48f7-aaed-bb77451319ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78119ea-1eab-499e-abbe-b576edefb5e3", "name": "network-vif-plugged", "status": "completed", "tag": "044e55a6-82c3-4dbe-83ac-6d2976f46c95"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:20.223564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3f4a14c3-8307-4e2c-856e-faf700e115db req-8ab405b3-a1b5-48f7-aaed-bb77451319ee service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.224403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3f4a14c3-8307-4e2c-856e-faf700e115db req-8ab405b3-a1b5-48f7-aaed-bb77451319ee service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.225304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3f4a14c3-8307-4e2c-856e-faf700e115db req-8ab405b3-a1b5-48f7-aaed-bb77451319ee service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.239382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-3f4a14c3-8307-4e2c-856e-faf700e115db req-8ab405b3-a1b5-48f7-aaed-bb77451319ee service nova] Creating event network-vif-plugged:044e55a6-82c3-4dbe-83ac-6d2976f46c95 for instance c78119ea-1eab-499e-abbe-b576edefb5e3 on hv-cinder-85265 Aug 18 21:03:20.246258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-3f4a14c3-8307-4e2c-856e-faf700e115db req-8ab405b3-a1b5-48f7-aaed-bb77451319ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038207 Aug 18 21:03:20.247189 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 454/905] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:03:20.409660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:20.410185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:20.413710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-71662c08-ae5e-4e14-bb4e-dcf5e52e0535 req-0e8cc5c5-543f-463a-8fca-87ddba4b45c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36afd51b-5953-4414-8efe-b33c3e8a2fda", "tag": "febcfc1a-0d17-4c46-ba69-4e78e95c42a3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:20.418149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.418651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.419099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.419832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.420290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.420712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.426180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-71662c08-ae5e-4e14-bb4e-dcf5e52e0535 req-0e8cc5c5-543f-463a-8fca-87ddba4b45c8 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.434497 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-71662c08-ae5e-4e14-bb4e-dcf5e52e0535 req-0e8cc5c5-543f-463a-8fca-87ddba4b45c8 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.434497 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-71662c08-ae5e-4e14-bb4e-dcf5e52e0535 req-0e8cc5c5-543f-463a-8fca-87ddba4b45c8 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.439993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-71662c08-ae5e-4e14-bb4e-dcf5e52e0535 req-0e8cc5c5-543f-463a-8fca-87ddba4b45c8 service nova] Creating event network-changed:febcfc1a-0d17-4c46-ba69-4e78e95c42a3 for instance 36afd51b-5953-4414-8efe-b33c3e8a2fda on hv-cinder-85265 Aug 18 21:03:20.445260 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-71662c08-ae5e-4e14-bb4e-dcf5e52e0535 req-0e8cc5c5-543f-463a-8fca-87ddba4b45c8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037648 Aug 18 21:03:20.446254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 455/906] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:03:20.449333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Going to try to terminate instance {{(pid=127937) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:03:20.543952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:20.544752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:20.551955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.553211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.553775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.554592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.555145 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.555840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.591166 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:20.869743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:20.881352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7257aeb7-6d8d-40e3-a553-9fb82147a187 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.342115 Aug 18 21:03:20.894694 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 456/907] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:20 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:03:20.894927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-50527ee7-cc53-4111-9df9-e13e51b2374a tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "DELETE /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 204 len: 0 microversion: 2.1 time: 0.472685 Aug 18 21:03:20.894927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 452/908] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:03:20 2022] DELETE /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:03:20.895471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:20.895471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:20.901305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:20.901305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:20.908188 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.909240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.914146 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.914951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.922376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.922376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.922376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.922376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:20.922765 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.922765 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:20.923570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:20.924135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:21.071784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:21.075880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:21.081360 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:21.083483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:21.088444 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1b11f98f-2083-4283-8963-ed6e0b924d2e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.187943 Aug 18 21:03:21.088444 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 453/909] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:20 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:03:21.088677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9f03e5f4-f7a6-48b9-b7a4-6fd40b8e1354 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1746 microversion: 2.20 time: 0.197748 Aug 18 21:03:21.088677 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 457/910] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:20 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:21.902014 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:21.902650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:21.910034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:21.910522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:21.910956 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:21.911678 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:21.912129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:21.913062 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:22.043692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:22.051743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-596e8591-5101-4ad1-9513-7725f018ab5e tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.153683 Aug 18 21:03:22.052300 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 454/911] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:21 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:03:22.106967 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:22.107698 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:22.108623 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:22.109244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:22.114087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:22.114569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:22.115003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:22.115448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:22.116285 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:22.116499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:22.116737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:22.116965 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:22.117158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:22.117670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:22.118128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:22.118605 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:22.259115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:22.266866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b0b6798e-5636-4551-a509-69a8ad10e8cf tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1568 microversion: 2.1 time: 0.163778 Aug 18 21:03:22.267534 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 458/912] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:22 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:22.281249 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-25dfb62e-4668-4c53-8c2e-19fd39c1c846 req-e5e5d486-a497-4851-810a-5fd80354634c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e18af4-e43d-4a3e-8927-934dd31062c1", "name": "network-vif-plugged", "status": "completed", "tag": "325a8ac4-261b-41ac-a3ca-a40a5b74b70f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:22.281389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:22.288738 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-25dfb62e-4668-4c53-8c2e-19fd39c1c846 req-e5e5d486-a497-4851-810a-5fd80354634c service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:22.289264 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-25dfb62e-4668-4c53-8c2e-19fd39c1c846 req-e5e5d486-a497-4851-810a-5fd80354634c service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:22.289852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-25dfb62e-4668-4c53-8c2e-19fd39c1c846 req-e5e5d486-a497-4851-810a-5fd80354634c service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:22.290412 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:22.292032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:22.293306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f9b2a3a5-5639-454e-8acc-275c63539d46 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1746 microversion: 2.20 time: 0.188554 Aug 18 21:03:22.293947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 455/913] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:22 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:03:22.301291 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-25dfb62e-4668-4c53-8c2e-19fd39c1c846 req-e5e5d486-a497-4851-810a-5fd80354634c service nova] Creating event network-vif-plugged:325a8ac4-261b-41ac-a3ca-a40a5b74b70f for instance 93e18af4-e43d-4a3e-8927-934dd31062c1 on hv-cinder-85265 Aug 18 21:03:22.306163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-25dfb62e-4668-4c53-8c2e-19fd39c1c846 req-e5e5d486-a497-4851-810a-5fd80354634c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031513 Aug 18 21:03:22.306718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 459/914] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:03:23.073884 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:23.074474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:23.080866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:23.081344 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:23.081770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:23.082452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:23.082894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:23.083317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:23.216141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:23.223751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e33227f4-9bc0-4b90-96f2-452832f81318 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1314 microversion: 2.1 time: 0.153662 Aug 18 21:03:23.224313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 456/915] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:23 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:23.290184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:23.291008 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:23.297715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:23.298201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:23.298643 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:23.299337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:23.299817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:23.300252 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:23.316063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:23.316665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:23.323431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:23.323972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:23.324339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:23.325061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:23.325509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:23.325927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:23.442298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:23.451057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ab5cc827-76a1-4923-a243-792b5b2f3447 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1449 microversion: 2.1 time: 0.165612 Aug 18 21:03:23.452795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 460/916] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:23 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1449 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:23.464782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:23.473408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:23.475034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:23.476402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e449224c-2f5f-4a4f-a82a-536aa0f98f6e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1746 microversion: 2.20 time: 0.164279 Aug 18 21:03:23.476940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 457/917] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:23 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:03:24.244806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:24.245433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:24.251525 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:24.252016 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:24.252507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:24.253160 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:24.253614 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:24.254045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:24.444214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-752bf97c-45da-4e9d-9c4f-8b9b2fc106e2 req-1a48584b-bcbb-40f6-a598-0641bb3261a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36afd51b-5953-4414-8efe-b33c3e8a2fda", "name": "network-vif-deleted", "tag": "febcfc1a-0d17-4c46-ba69-4e78e95c42a3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:24.454561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-752bf97c-45da-4e9d-9c4f-8b9b2fc106e2 req-1a48584b-bcbb-40f6-a598-0641bb3261a9 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:24.455046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-752bf97c-45da-4e9d-9c4f-8b9b2fc106e2 req-1a48584b-bcbb-40f6-a598-0641bb3261a9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:24.455505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-752bf97c-45da-4e9d-9c4f-8b9b2fc106e2 req-1a48584b-bcbb-40f6-a598-0641bb3261a9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:24.467383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-752bf97c-45da-4e9d-9c4f-8b9b2fc106e2 req-1a48584b-bcbb-40f6-a598-0641bb3261a9 service nova] Creating event network-vif-deleted:febcfc1a-0d17-4c46-ba69-4e78e95c42a3 for instance 36afd51b-5953-4414-8efe-b33c3e8a2fda on hv-cinder-85265 Aug 18 21:03:24.472342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-752bf97c-45da-4e9d-9c4f-8b9b2fc106e2 req-1a48584b-bcbb-40f6-a598-0641bb3261a9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Aug 18 21:03:24.472952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 458/918] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:03:24.478669 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:24.479500 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:24.485847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:24.486338 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:24.486775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:24.487522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:24.487977 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:24.488490 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:24.528818 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:24.540322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-82e5e218-a173-46e9-a696-26fe24676c38 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1498 microversion: 2.1 time: 0.299799 Aug 18 21:03:24.540934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 461/919] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:24 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1498 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:24.545781 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:24.546860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:24.553766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:24.554486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:24.555082 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:24.555850 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:24.556304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:24.556732 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:24.577616 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:24.581857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-586770f7-feb2-4078-b98e-97ecad47427b tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1381 microversion: 2.1 time: 0.107542 Aug 18 21:03:24.582564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 459/920] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:24 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1381 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:24.797617 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:24.806011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:24.807578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:24.808793 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1c710e60-c25f-4437-8a84-c8b41e0c7df1 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1746 microversion: 2.20 time: 0.266890 Aug 18 21:03:24.809357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 462/921] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:24 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1746 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:25.556351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:25.556901 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:25.563342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.563800 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.564236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.565007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.565466 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.565895 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.591660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Going to try to terminate instance {{(pid=127937) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:03:25.605102 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:25.613204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:25.613204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.613744 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.614283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.614996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.616039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.616553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.653369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.653859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.654420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.654848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lazy-loading 'fault' on Instance uuid 36afd51b-5953-4414-8efe-b33c3e8a2fda {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:03:25.702406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:25.710148 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2a5b7b9a-5254-4f6f-9298-fbbb9fb1b54f tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1223 microversion: 2.1 time: 0.109191 Aug 18 21:03:25.719271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 463/922] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:25 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:03:25.832416 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:25.833096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:25.839565 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.846906 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.846906 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.846906 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.846906 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.847322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.866574 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-241e85bc-a1f6-4874-bac5-b8f17845ba4a tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "DELETE /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 204 len: 0 microversion: 2.1 time: 0.313480 Aug 18 21:03:25.867348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 460/923] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:03:25 2022] DELETE /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:03:25.880819 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:25.881776 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:25.894368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.894856 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.895319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:25.896040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:25.897079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:25.897661 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:26.015473 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:26.029481 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:26.036530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:26.036530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-635eb0ef-e203-477a-9d3b-ddb13534c9a2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.204157 Aug 18 21:03:26.036530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 464/924] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:25 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:03:26.057506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:26.066314 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-87c83287-075e-4e1f-b1c4-28c2c978b1fd tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1504 microversion: 2.1 time: 0.190326 Aug 18 21:03:26.066896 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 461/925] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:25 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:26.732094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:26.733492 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:26.741204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:26.741842 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:26.742511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:26.743464 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:26.744013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:26.744789 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:26.749377 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=100 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:26.780551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:26.781389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:26.782019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:26.782772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lazy-loading 'fault' on Instance uuid 36afd51b-5953-4414-8efe-b33c3e8a2fda {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:03:26.829683 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72e153ab64294e518c3ce4ac03077ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '209bb8eb567b434088d163ae1eafe79c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:26.842976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-61806e3a-ea64-44ef-bc92-c8a745f5ee8e tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 200 len: 1223 microversion: 2.1 time: 0.114834 Aug 18 21:03:26.843585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 465/926] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:26 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:27.059650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:27.060988 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:27.068273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:27.069031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:27.069635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:27.070507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:27.071124 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:27.071737 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:27.089200 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:27.090216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:27.098040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:27.098856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:27.099577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:27.104549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:27.105364 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:27.105993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:27.281449 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:27.293817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:27.295857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:27.297799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-54be3a0f-f283-4395-a642-a6e5be5e7ec4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.241725 Aug 18 21:03:27.298750 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 462/927] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:27 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:27.326461 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:27.347399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d5b117a6-7166-4ac9-9e81-524e573d0451 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1504 microversion: 2.1 time: 0.263556 Aug 18 21:03:27.365905 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 466/928] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:27 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1504 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:27.864501 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:27.865154 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] [instance: 36afd51b-5953-4414-8efe-b33c3e8a2fda] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:27.872303 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:27.872793 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:27.873426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:27.874301 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:27.874913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:27.875544 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:27.894302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] HTTP exception thrown: Instance 36afd51b-5953-4414-8efe-b33c3e8a2fda could not be found. Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Request method failure captured: Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda HTTP/1.1 Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qeQLiQGrYGCON4HMAHNOlqfhdSqm4olj500xO_T2TfvjgszY2JO5tpBmNtZFxtUWF0mvHRs85Dj3lmPNw2NzhIjF9bR7K4NqsfaJDRuK4banBvm9KfY09VxKBa0RtgORh6OF7_09TyyGA-j7JxrghJF1TmVBlaporGS8YLI3gG0utU Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 209bb8eb567b434088d163ae1eafe79c Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-TestShelveInstance-814374747 Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:03:27.896489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_209bb8eb567b434088d163ae1eafe79c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/209bb8eb567b434088d163ae1eafe79c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/209bb8eb567b434088d163ae1eafe79c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/209bb8eb567b434088d163ae1eafe79c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-TestShelveInstance-814374747 Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 209bb8eb567b434088d163ae1eafe79c Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-TestShelveInstance-814374747 Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-TestShelveInstance-814374747-project Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 72e153ab64294e518c3ce4ac03077ab8 Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-TestShelveInstance-814374747-project Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 36afd51b-5953-4414-8efe-b33c3e8a2fda could not be found. Aug 18 21:03:27.898126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '36afd51b-5953-4414-8efe-b33c3e8a2fda'} Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36afd51b-5953-4414-8efe-b33c3e8a2fda could not be found. Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:03:27.899063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36afd51b-5953-4414-8efe-b33c3e8a2fda could not be found. Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36afd51b-5953-4414-8efe-b33c3e8a2fda could not be found. Aug 18 21:03:27.900721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:03:27.903009 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Returning 404 to user: Instance 36afd51b-5953-4414-8efe-b33c3e8a2fda could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:03:27.903904 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-92808a85-cb00-4b6c-9128-ef041c7d2061 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda" status: 404 len: 111 microversion: 2.1 time: 0.043553 Aug 18 21:03:27.904458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 463/929] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:27 2022] GET /compute/v2.1/servers/36afd51b-5953-4414-8efe-b33c3e8a2fda => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:03:28.179382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2cfce4a5-d442-4aa8-8d67-fdd2b88decd4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] Calling method '.version_select at 0x7f8b5a228670>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:28.300210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2cfce4a5-d442-4aa8-8d67-fdd2b88decd4 tempest-TestShelveInstance-814374747 tempest-TestShelveInstance-814374747-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-85954469" status: 202 len: 0 microversion: 2.1 time: 0.125381 Aug 18 21:03:28.301147 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 467/930] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 21:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-85954469 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:03:28.333196 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:28.333196 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:28.347710 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-981f6194-7b20-441f-869b-20a51fc5cbe8 req-f1d614cf-696d-4ae1-a08d-0c624d518286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78119ea-1eab-499e-abbe-b576edefb5e3", "name": "network-vif-deleted", "tag": "044e55a6-82c3-4dbe-83ac-6d2976f46c95"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:28.358573 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:28.359205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:28.359873 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:28.360113 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-981f6194-7b20-441f-869b-20a51fc5cbe8 req-f1d614cf-696d-4ae1-a08d-0c624d518286 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:28.360411 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:28.360782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-981f6194-7b20-441f-869b-20a51fc5cbe8 req-f1d614cf-696d-4ae1-a08d-0c624d518286 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:28.360927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:28.361261 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:28.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-981f6194-7b20-441f-869b-20a51fc5cbe8 req-f1d614cf-696d-4ae1-a08d-0c624d518286 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:28.372954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-981f6194-7b20-441f-869b-20a51fc5cbe8 req-f1d614cf-696d-4ae1-a08d-0c624d518286 service nova] Creating event network-vif-deleted:044e55a6-82c3-4dbe-83ac-6d2976f46c95 for instance c78119ea-1eab-499e-abbe-b576edefb5e3 on hv-cinder-85265 Aug 18 21:03:28.379276 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-981f6194-7b20-441f-869b-20a51fc5cbe8 req-f1d614cf-696d-4ae1-a08d-0c624d518286 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034955 Aug 18 21:03:28.383603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 468/931] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:03:28.389081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:28.401484 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:28.413017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:28.413666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:28.414202 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:28.415211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:28.415928 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:28.416733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:28.495084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:28.504155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d6d5e391-2487-4abd-b365-2d4dd71e37f5 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1462 microversion: 2.1 time: 0.119147 Aug 18 21:03:28.515903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 469/932] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:28 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1462 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:28.610852 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:28.620094 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:28.625339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:28.628308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e16d0efd-6a8f-40f2-bb02-6d4060b12de7 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.306120 Aug 18 21:03:28.630808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 464/933] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:28 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:29.120587 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:03:29.121276 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Thu Aug 18 21:03:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:03:29.527227 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:29.527918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:29.534803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:29.535282 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:29.535745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:29.536442 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:29.536897 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:29.537400 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:29.568961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:29.569507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:29.569945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:29.570392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lazy-loading 'fault' on Instance uuid c78119ea-1eab-499e-abbe-b576edefb5e3 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:03:29.611267 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b36de9654d42a685c96ec7ea6608f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32366eaaa6d342adb39c9175a121324a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:29.620368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0784fd8b-9460-4d3d-9f69-71cb7f29f185 tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 200 len: 1304 microversion: 2.1 time: 0.096614 Aug 18 21:03:29.620944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 470/934] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:29 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:03:29.654595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:29.660122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:29.661765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:29.662248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:29.662681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:29.663410 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:29.663930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:29.664353 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:29.930879 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:29.940118 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:29.941939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:29.944120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8793bddc-ca00-466a-adab-d52d85235291 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.293421 Aug 18 21:03:29.960495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 465/935] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:29 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:30.642012 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:30.644513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] [instance: c78119ea-1eab-499e-abbe-b576edefb5e3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:30.663073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:30.663296 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:30.665076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:30.666025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:30.666637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:30.669820 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:30.685976 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] HTTP exception thrown: Instance c78119ea-1eab-499e-abbe-b576edefb5e3 could not be found. Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Request method failure captured: Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 HTTP/1.1 Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qjz-KavqinWVg0br-i4FjDZQ_lFnalvyk_m2u2rLkFRlEaDwbwEXDZMNyMFsFvOnUbkr9eKjolOtu8m0zx0OJHNIp2wJBpFKUU-7jLqUUpL9rRWcOK6FGGnCy1BW26Qi94UyL6usKm_E4VbKeG-N63RkUScIEmMozibRDaMbFvrE5A Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 32366eaaa6d342adb39c9175a121324a Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesActionsTest-1069603505 Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:03:30.687952 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_32366eaaa6d342adb39c9175a121324a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/32366eaaa6d342adb39c9175a121324a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/32366eaaa6d342adb39c9175a121324a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/32366eaaa6d342adb39c9175a121324a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesActionsTest-1069603505 Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 32366eaaa6d342adb39c9175a121324a Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesActionsTest-1069603505 Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesActionsTest-1069603505-project Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: d1b36de9654d42a685c96ec7ea6608f3 Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesActionsTest-1069603505-project Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance c78119ea-1eab-499e-abbe-b576edefb5e3 could not be found. Aug 18 21:03:30.689603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'c78119ea-1eab-499e-abbe-b576edefb5e3'} Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78119ea-1eab-499e-abbe-b576edefb5e3 could not be found. Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:03:30.690583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78119ea-1eab-499e-abbe-b576edefb5e3 could not be found. Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78119ea-1eab-499e-abbe-b576edefb5e3 could not be found. Aug 18 21:03:30.692566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:03:30.696136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] Returning 404 to user: Instance c78119ea-1eab-499e-abbe-b576edefb5e3 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:03:30.697177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9bf5eea7-08c1-441f-9a6c-6d10d832a90c tempest-VolumesActionsTest-1069603505 tempest-VolumesActionsTest-1069603505-project] 10.222.0.62 "GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3" status: 404 len: 111 microversion: 2.1 time: 0.059189 Aug 18 21:03:30.701718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 471/936] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:03:30 2022] GET /compute/v2.1/servers/c78119ea-1eab-499e-abbe-b576edefb5e3 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:03:30.967760 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:30.969694 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:30.977150 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:30.978720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:30.979329 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:30.980745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:30.980745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:30.981767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:31.290623 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:31.299494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:31.301003 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:31.302232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9381b29b-86be-45f6-b169-dad4f0889431 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.338579 Aug 18 21:03:31.308268 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 466/937] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:30 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:32.336687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:32.338101 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:32.346061 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:32.346838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:32.347273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:32.348024 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:32.349148 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:32.349802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:32.668723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:32.683859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:32.713742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:32.714982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-59a7a345-ec78-4a29-b6c3-4f3f20121f8a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.386329 Aug 18 21:03:32.738041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 472/938] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:32 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:33.743114 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:33.744519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:33.751761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:33.752247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:33.752684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:33.753390 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:33.753850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:33.754280 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:34.212210 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:34.226858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:34.228955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:34.230409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f207108f-19ac-4e85-aafd-187217177ec3 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.492448 Aug 18 21:03:34.232371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 467/939] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:33 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:35.265788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:35.267216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:35.285749 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:35.286547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:35.287855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:35.291310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:35.291821 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:35.292259 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:35.530800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:35.545176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:35.548603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:35.551042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-90f05684-363d-4f38-923b-9a521bbd7972 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.289940 Aug 18 21:03:35.552317 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 473/940] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:35 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:36.580572 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:36.581949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:36.594193 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:36.595743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:36.597805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:36.599879 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:36.600362 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:36.600796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:36.802649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:36.806396 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:36.815565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:36.817529 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:36.819447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-481c9be1-7706-4d7b-af31-39313f12a811 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.242753 Aug 18 21:03:36.826523 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 468/941] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:36 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:37.843285 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:37.844065 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:37.860418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:37.863091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:37.863578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:37.866085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:37.866569 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:37.866991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:38.175848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:38.185720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:38.187143 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:38.188341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-10ff447c-0a5f-4fd7-bcae-aa1d44811f68 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.350072 Aug 18 21:03:38.188897 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 474/942] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:37 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:39.213710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:39.214467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:39.233148 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:39.235196 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:39.237232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:39.242620 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:39.242620 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:39.242620 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:39.468860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:39.484925 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:39.486415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:39.493136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-061a6181-1bad-42c4-937d-a0b356c09c26 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1741 microversion: 2.20 time: 0.279232 Aug 18 21:03:39.493989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 469/943] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:39 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1741 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:40.522703 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:40.524598 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:40.532451 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:40.533262 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:40.534283 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:40.535168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:40.535652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:40.536083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:40.721932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:40.735803 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:40.739163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:40.741148 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-74d5d625-6fb0-4762-8376-6d6c510ed1c8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1723 microversion: 2.20 time: 0.223076 Aug 18 21:03:40.741705 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 475/944] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:40 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:41.776440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:41.777061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:41.787999 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:41.788889 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:41.789770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:41.790814 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:41.791541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:41.792180 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:41.961876 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:41.973398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:41.975609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:41.977099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-09081206-7f31-4653-bee9-1f8f6cb67543 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1723 microversion: 2.20 time: 0.204403 Aug 18 21:03:41.977696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 470/945] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:41 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:42.436971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-15863313-f5c6-45c1-9fb8-f01d985709d7 req-045c19e9-32e4-4fdb-8f30-3abfb1a34d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e18af4-e43d-4a3e-8927-934dd31062c1", "name": "network-vif-unplugged", "status": "completed", "tag": "325a8ac4-261b-41ac-a3ca-a40a5b74b70f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:42.478152 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-15863313-f5c6-45c1-9fb8-f01d985709d7 req-045c19e9-32e4-4fdb-8f30-3abfb1a34d28 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:42.479103 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-15863313-f5c6-45c1-9fb8-f01d985709d7 req-045c19e9-32e4-4fdb-8f30-3abfb1a34d28 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:42.480210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-15863313-f5c6-45c1-9fb8-f01d985709d7 req-045c19e9-32e4-4fdb-8f30-3abfb1a34d28 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:42.497367 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-15863313-f5c6-45c1-9fb8-f01d985709d7 req-045c19e9-32e4-4fdb-8f30-3abfb1a34d28 service nova] Creating event network-vif-unplugged:325a8ac4-261b-41ac-a3ca-a40a5b74b70f for instance 93e18af4-e43d-4a3e-8927-934dd31062c1 on hv-cinder-85265 Aug 18 21:03:42.509745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-15863313-f5c6-45c1-9fb8-f01d985709d7 req-045c19e9-32e4-4fdb-8f30-3abfb1a34d28 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072792 Aug 18 21:03:42.511413 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 476/946] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:03:43.002843 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:43.008565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:43.012223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:43.013613 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:43.014099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:43.014981 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:43.015618 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:43.016120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:43.187868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:43.197608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:43.199147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:43.201432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8a8e38ec-e501-4eb4-9402-204babcc4f89 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1726 microversion: 2.20 time: 0.204194 Aug 18 21:03:43.202178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 471/947] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:42 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1726 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:43.227139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00c444cd-261a-415b-a39b-668f642d2da2"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:43.229852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:43.236272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:43.236762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:43.237203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:43.237908 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:43.238361 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:43.238790 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:44.252163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7bde5e65-dbbb-480e-a8e8-4edc1eddc4b6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.030106 Aug 18 21:03:44.253653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 477/948] 10.222.0.62 () {62 vars in 1364 bytes} [Thu Aug 18 21:03:43 2022] POST /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-volume_attachments => generated 188 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:03:44.398309 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:44.398866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:44.405329 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:44.405833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:44.406269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:44.406955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:44.407888 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:44.407888 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:45.053694 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8ebe842c-5ca7-4d5d-9aaf-badf122feab4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-volume_attachments/00c444cd-261a-415b-a39b-668f642d2da2" status: 202 len: 0 microversion: 2.20 time: 0.659307 Aug 18 21:03:45.055406 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 472/949] 10.222.0.62 () {60 vars in 1457 bytes} [Thu Aug 18 21:03:44 2022] DELETE /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-volume_attachments/00c444cd-261a-415b-a39b-668f642d2da2 => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 21:03:45.131117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:03:45.133268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:45.143492 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:45.144183 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:45.144955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:45.146168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:45.146951 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:45.147701 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:45.218490 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127936) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 21:03:45.587553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9d13121a-a1ce-4016-a2ff-f2d270fb03b5 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "POST /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/action" status: 202 len: 0 microversion: 2.20 time: 0.464613 Aug 18 21:03:45.589044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 478/950] 10.222.0.62 () {62 vars in 1319 bytes} [Thu Aug 18 21:03:45 2022] POST /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:03:45.597664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:45.598351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:45.608963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:45.608963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:45.608963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:45.609666 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:45.610321 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:45.610592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:45.792041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:45.803474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:45.805554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:45.807271 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-97cd2579-bb36-46df-ae83-9499c151313a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1674 microversion: 2.20 time: 0.213576 Aug 18 21:03:45.820249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 473/951] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:45 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:46.833231 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:46.833848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:46.841992 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:46.860675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:46.860675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:46.860675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:46.860675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:46.861120 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:47.068209 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:47.079690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:47.081405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:47.083216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-10bcc44b-e63e-4aa7-8dc4-6bc7ea66fd8d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1674 microversion: 2.20 time: 0.255757 Aug 18 21:03:47.084471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 479/952] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:46 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:48.106911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:48.107726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:48.114280 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:48.114773 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:48.115779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:48.116495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:48.116954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:48.117379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:48.269588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:48.280028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:48.281846 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:48.283293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c29c3bf0-846c-47aa-b479-c3e90e7aae66 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.180624 Aug 18 21:03:48.284476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 474/953] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:48 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:49.308733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:49.309387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:49.312072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:49.317360 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:49.317859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:49.318858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:49.319825 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:49.320315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:49.320756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:49.340159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:49.510863 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:49.523666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:49.525374 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:49.527562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f3ab1836-e5ed-43b2-8bdc-49262567b1b8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.223303 Aug 18 21:03:49.528687 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 480/954] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:49 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:50.554467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:50.555117 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:50.557579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:50.563061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:50.563606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:50.564093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:50.564789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:50.565266 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:50.565718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:50.721342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:50.731039 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:50.736975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:50.736975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5eb7b34e-778e-4393-8f4d-8ba8cafadfbf tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.185666 Aug 18 21:03:50.736975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 475/955] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:50 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:51.758683 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:51.760141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:51.769433 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:51.770435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:51.771571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:51.772696 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:51.773456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:51.774142 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:51.958576 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:51.969823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:51.972324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:51.985496 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f37cc5cb-ce4a-409d-8cc4-5f2eb51256d0 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.220220 Aug 18 21:03:51.988293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 481/956] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:51 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:53.004074 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:53.009426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:53.016719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:53.017242 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:53.017742 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:53.018422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:53.019500 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:53.020825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:53.264793 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:53.280926 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:53.282440 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:53.283804 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3c883890-4387-4acc-9695-a040e30b72ca tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.285285 Aug 18 21:03:53.284998 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 476/957] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:52 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:54.309558 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:54.310956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:54.317714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:54.318582 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:54.319254 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:54.320258 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:54.321170 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:54.321818 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:54.516528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:54.529640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:54.529640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:54.529640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3ca7b9a1-d7f1-41c7-b332-94ad14b0e784 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.224180 Aug 18 21:03:54.536604 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 482/958] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:54 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:55.562674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:55.563479 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:55.572343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:55.572906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:55.573389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:55.574101 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:55.574554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:55.575013 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:55.707944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:55.716480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:55.723650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:55.723650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b809b341-7c32-42ca-bfef-d9a16fc64698 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.161815 Aug 18 21:03:55.723650 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 477/959] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:55 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:56.742339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:56.751203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:56.751203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:56.751203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:56.751203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:56.751608 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:56.751854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:56.752560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:56.883211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:56.892119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:56.893648 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:56.894844 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8ae0fe68-5eba-4f4e-9bf9-d7fd55d60b2e tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.156527 Aug 18 21:03:56.895751 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 483/960] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:56 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:03:57.918467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:57.919184 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:57.926788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:57.930950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:57.930950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:57.930950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:57.930950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:57.931334 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:58.091995 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:58.101606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:58.103211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:58.104494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c8651abe-c4f2-4d11-b7c0-723f615a52e2 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.189936 Aug 18 21:03:58.105126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 478/961] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:57 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:03:59.130007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:03:59.130752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:03:59.137257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:59.137743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:59.138181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:59.138873 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:03:59.139323 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:03:59.139776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:03:59.309552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:59.326581 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:59.328948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:03:59.333074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-863d6b71-447b-4231-80a7-e1a09b563c72 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.206910 Aug 18 21:03:59.335494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 484/962] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:03:59 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:00.359041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:00.359681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:00.366700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:00.367328 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:00.367794 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:00.368493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:00.368951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:00.369377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:00.510769 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:00.519505 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:00.521628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:00.522912 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-484f91fa-8670-41aa-8d4b-1a43a3fe6cc4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.168371 Aug 18 21:04:00.523903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 479/963] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:00 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:04:01.547637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:01.548277 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:01.556079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:01.556852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:01.557381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:01.558175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:01.558787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:01.559512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:01.721693 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:01.732320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:01.733819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:01.735002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-79a48107-8768-4417-a75b-f91630d59084 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.191483 Aug 18 21:04:01.735588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 485/964] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:01 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:02.757900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:02.763448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:02.765248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:02.765740 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:02.766174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:02.767075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:02.767563 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:02.768033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:02.910847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:02.920450 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:02.921413 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:02.922599 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-aa885e90-05c0-40e3-b0d7-f367b7e2427a tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.168606 Aug 18 21:04:02.923167 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 480/965] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:02 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:03.946443 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:03.947012 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:03.954074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:03.954584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:03.954987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:03.955723 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:03.956186 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:03.956614 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:04.120190 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:04.130554 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:04.132914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:04.134117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-840d4c87-b177-4c35-9b5e-606575d9ece6 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.192313 Aug 18 21:04:04.134665 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 486/966] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:03 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:05.164774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:05.170287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:05.172185 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:05.173885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:05.173885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:05.173885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:05.174306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:05.174646 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:05.559033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:05.567297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:05.569357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:05.571443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a47baf74-d8f9-48bd-b089-e8a7c59d344d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.410342 Aug 18 21:04:05.571997 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 481/967] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:05 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:06.595041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:06.595874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:06.603639 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:06.604133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:06.604571 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:06.605287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:06.605778 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:06.606211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:06.755997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:06.765309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:06.766743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:06.767950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0c4435d7-6a52-4aa8-8feb-7c8b15b0666f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.176920 Aug 18 21:04:06.768526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 487/968] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:06 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:07.792252 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:07.793190 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:07.800567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:07.801417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:07.801918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:07.802900 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:07.804197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:07.804779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:07.956861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:07.964627 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:07.967955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:07.969879 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:07.971266 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a309b20f-6218-471b-a8cc-789fc2d47721 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.183908 Aug 18 21:04:07.979592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 482/969] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:07 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:08.995477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:08.996778 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:09.006002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:09.006002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:09.006002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:09.006002 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:09.006480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:09.007504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:09.542653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:09.552674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:09.555076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:09.556292 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-866777f3-e298-4790-97ca-c1f9a2bad100 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.565996 Aug 18 21:04:09.557051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 488/970] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:08 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:10.581654 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:10.582447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:10.590566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:10.591067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:10.593306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:10.594419 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:10.595065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:10.595710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:10.807499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-1b1adf08-6869-45f9-856b-92dba5fd6564 req-cfcf0230-bdf9-46c0-a2e6-c452c47796b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e18af4-e43d-4a3e-8927-934dd31062c1", "name": "network-vif-plugged", "status": "completed", "tag": "325a8ac4-261b-41ac-a3ca-a40a5b74b70f"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:10.811199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:10.818869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1b1adf08-6869-45f9-856b-92dba5fd6564 req-cfcf0230-bdf9-46c0-a2e6-c452c47796b7 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:10.819535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1b1adf08-6869-45f9-856b-92dba5fd6564 req-cfcf0230-bdf9-46c0-a2e6-c452c47796b7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:10.820098 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1b1adf08-6869-45f9-856b-92dba5fd6564 req-cfcf0230-bdf9-46c0-a2e6-c452c47796b7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:10.825049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:10.830018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:10.830018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d93b7bf7-abcf-4584-9995-7e1aa4d95ba8 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.251066 Aug 18 21:04:10.830018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 483/971] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:10 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:10.845417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-1b1adf08-6869-45f9-856b-92dba5fd6564 req-cfcf0230-bdf9-46c0-a2e6-c452c47796b7 service nova] Creating event network-vif-plugged:325a8ac4-261b-41ac-a3ca-a40a5b74b70f for instance 93e18af4-e43d-4a3e-8927-934dd31062c1 on hv-cinder-85265 Aug 18 21:04:10.851754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-1b1adf08-6869-45f9-856b-92dba5fd6564 req-cfcf0230-bdf9-46c0-a2e6-c452c47796b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052735 Aug 18 21:04:10.852522 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 489/972] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:04:11.850825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:11.851521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:11.858135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:11.858625 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:11.859065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:11.859805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:11.860263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:11.860691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:12.020905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:12.030027 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:12.031593 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:12.032935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-16705838-beaa-44eb-9349-fff877a42bde tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.186101 Aug 18 21:04:12.033686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 484/973] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:11 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:13.057753 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:13.058462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:13.066036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:13.066585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:13.067273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:13.068134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:13.069384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:13.070098 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:13.294559 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:13.308106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:13.310029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:13.311924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3e599b56-f429-4980-a2cd-2b1b83a2bb5c tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.259390 Aug 18 21:04:13.317156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 490/974] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:13 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:13.825407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:13.826173 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:13.841265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:13.842714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:13.843692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:13.844905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:13.845587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:13.846182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:13.889539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b83237c8-7513-4d25-865f-acd99b886a38 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.069078 Aug 18 21:04:13.900421 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 485/975] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 21:04:13 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/ips => generated 150 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:14.337791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:14.339186 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:14.347728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:14.348719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:14.349441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:14.350907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:14.351654 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:14.352328 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:14.619798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:14.630940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:14.633342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:14.634588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-893ac423-c528-4767-80cd-7dcdf771ef2d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1732 microversion: 2.20 time: 0.302412 Aug 18 21:04:14.652438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 491/976] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:14 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1732 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:15.658142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:15.658882 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:15.668218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:15.670372 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:15.672641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:15.674051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:15.675608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:15.676218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:15.703783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72e34561-e577-4d8a-b7e5-10bee3e916ee"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:15.706811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:15.713381 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:15.714753 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:15.714753 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:15.715480 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:15.715939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:15.716564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:15.912536 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:15.922621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:15.935104 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:15.937276 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-51139b01-a329-42dc-9813-26aa27225182 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1719 microversion: 2.20 time: 0.282955 Aug 18 21:04:15.948832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 486/977] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:04:15 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1719 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:04:16.557807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e6b5bf93-23da-47dd-85c7-9df0a9d24564 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "POST /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858065 Aug 18 21:04:16.564138 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 492/978] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:04:15 2022] POST /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:04:17.247958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ad620a53-39c7-4d5d-8f9e-2a107e063ce8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Action: 'create', calling method: .version_select at 0x7f8b5a4bff70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2088657920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9vshhKqHfwF7LNpUtn4oM08viGZSjGbkDMH2SyecJHMY5E5mub1b4njmjOgrQ4nL6x2MCbR6QSp/w8zwLdjBl4TD5iNH4osI8P7kUOo31DPWQokUlUUIsriQwsIE6j8g=="}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:17.274195 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-ad620a53-39c7-4d5d-8f9e-2a107e063ce8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:04:17.278603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-ad620a53-39c7-4d5d-8f9e-2a107e063ce8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for user e9c8beca893f40f08befa76dd712285f and project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:04:17.431119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ad620a53-39c7-4d5d-8f9e-2a107e063ce8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.359631 Aug 18 21:04:17.432711 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 487/979] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 21:04:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:24.253610 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:24.254186 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:24.257821 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=26 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:24.262750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:24.263234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:24.263704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:24.264406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:24.264862 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:24.265289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:24.269163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:24.352593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lazy-loading 'services' on Instance uuid b369215c-2bbc-48a0-83e2-67f84e76f9ca {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:04:24.572363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8725aefa-de95-4d47-af63-e0415a4d6215 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments/72e34561-e577-4d8a-b7e5-10bee3e916ee" status: 202 len: 0 microversion: 2.1 time: 0.322955 Aug 18 21:04:24.572992 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 493/980] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:04:24 2022] DELETE /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments/72e34561-e577-4d8a-b7e5-10bee3e916ee => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:04:24.582343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:24.585220 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:24.587603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:24.594359 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:24.594860 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:24.595304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:24.596058 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:24.596552 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:24.596985 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:24.628748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0d024054-a584-4599-baeb-5e9317d02113 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051073 Aug 18 21:04:24.629308 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 488/981] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:04:24 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:25.642661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:25.645201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:25.652684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:25.653176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:25.653613 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:25.654315 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:25.654771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:25.655201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:25.685855 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-afe87ce7-5d01-44eb-8568-4f928ac7c580 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047587 Aug 18 21:04:25.686422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 494/982] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:04:25 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:26.698203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:26.700421 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:26.707429 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:26.707919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:26.708355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:26.709058 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:26.709517 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:26.709945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:26.742994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4866aca9-6095-428f-bed0-2ad2baac16e3 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048771 Aug 18 21:04:26.743590 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 489/983] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:04:26 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:04:26.813085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:26.813747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:26.820257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:26.820749 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:26.821187 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:26.821888 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:26.822338 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:26.822764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:26.849184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:04:27.144752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a06cb59b-1f47-4918-b741-62c27aefed73 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 204 len: 0 microversion: 2.1 time: 0.335322 Aug 18 21:04:27.145515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 495/984] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:04:26 2022] DELETE /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:04:27.154475 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:27.155101 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:27.163254 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:27.163788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:27.164238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:27.164967 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:27.165421 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:27.166082 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:27.286297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=4 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:27.305691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:27.313750 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9c476903-86d7-4580-b32c-8550bb0db99b tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1682 microversion: 2.1 time: 0.163142 Aug 18 21:04:27.314323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 490/985] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:27 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:28.336673 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:28.337375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:28.344221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:28.344745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:28.345211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:28.345932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:28.346389 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:28.346827 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:28.489830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:28.497756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-929d82fb-144a-4d55-8cb0-004088a9df88 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1682 microversion: 2.1 time: 0.165839 Aug 18 21:04:28.498325 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 496/986] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:28 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:29.519797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:29.520522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:29.527335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:29.527898 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:29.528335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:29.529035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:29.529482 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:29.529903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:29.670431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:29.682902 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8b6d1738-06f8-4756-97d9-9c8e074ef889 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1682 microversion: 2.1 time: 0.167906 Aug 18 21:04:29.683686 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 491/987] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:29 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:30.409471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-124f1041-0765-4d9e-b376-fa51abe1c530 req-595a60c0-26b3-4f8f-8ead-761912eb49cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b369215c-2bbc-48a0-83e2-67f84e76f9ca", "name": "network-vif-deleted", "tag": "b374dc73-9026-428c-860c-1a23cc6ffac3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:30.428932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-124f1041-0765-4d9e-b376-fa51abe1c530 req-595a60c0-26b3-4f8f-8ead-761912eb49cf service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:30.429467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-124f1041-0765-4d9e-b376-fa51abe1c530 req-595a60c0-26b3-4f8f-8ead-761912eb49cf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:30.430123 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-124f1041-0765-4d9e-b376-fa51abe1c530 req-595a60c0-26b3-4f8f-8ead-761912eb49cf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:30.448145 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-124f1041-0765-4d9e-b376-fa51abe1c530 req-595a60c0-26b3-4f8f-8ead-761912eb49cf service nova] Creating event network-vif-deleted:b374dc73-9026-428c-860c-1a23cc6ffac3 for instance b369215c-2bbc-48a0-83e2-67f84e76f9ca on hv-cinder-85265 Aug 18 21:04:30.458243 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-124f1041-0765-4d9e-b376-fa51abe1c530 req-595a60c0-26b3-4f8f-8ead-761912eb49cf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054362 Aug 18 21:04:30.464111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 497/988] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:30.704468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:30.705208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:30.713312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:30.714332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:30.714897 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:30.715783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:30.716359 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:30.716897 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:30.798163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b5dd3c92034837921826c9b2dea76b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abf631fcae584ce1a0b8c26560398cea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:30.814431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-eddefe6f-fbe6-4d87-9e61-04c82b179ece tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 200 len: 1326 microversion: 2.1 time: 0.113548 Aug 18 21:04:30.815754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 492/989] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:30 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:31.840721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:31.841635 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:31.848218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:31.848706 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:31.849144 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:31.849854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:31.850303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:31.850727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:31.868228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca HTTP/1.1 Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:31.869956 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:31.872680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'b369215c-2bbc-48a0-83e2-67f84e76f9ca'} Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:31.874245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:31.876784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:31.879077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:31.879077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-31cc8c60-9fbb-4d5e-9282-09da1ecd680c tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 404 len: 111 microversion: 2.1 time: 0.036593 Aug 18 21:04:31.879077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 498/990] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:31 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:31.887591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9a52ddeb-63ed-46fa-a721-cc76b6d2e840 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '.version_select at 0x7f8b5a4f4790>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:31.979806 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9a52ddeb-63ed-46fa-a721-cc76b6d2e840 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920481492" status: 202 len: 0 microversion: 2.1 time: 0.099934 Aug 18 21:04:31.982468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 493/991] 10.222.0.62 () {58 vars in 1221 bytes} [Thu Aug 18 21:04:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920481492 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:04:34.146832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:34.147508 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:34.154291 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:34.154804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:34.155250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:34.156017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:34.156477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:34.156908 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:34.173746 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca HTTP/1.1 Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:34.175470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.178494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'b369215c-2bbc-48a0-83e2-67f84e76f9ca'} Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:34.180067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.182355 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.184728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:34.184728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-305b6de9-55d5-4997-aa87-d2df42dca49d tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 404 len: 111 microversion: 2.1 time: 0.034429 Aug 18 21:04:34.184728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 499/992] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:04:34 2022] DELETE /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:34.189703 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:34.190493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: b369215c-2bbc-48a0-83e2-67f84e76f9ca] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:34.198227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:34.198789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:34.199314 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:34.200149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:34.200714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:34.201207 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:34.216578 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca HTTP/1.1 Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:04:34.218157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.220670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': 'b369215c-2bbc-48a0-83e2-67f84e76f9ca'} Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:34.222236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. Aug 18 21:04:34.225035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:34.229848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance b369215c-2bbc-48a0-83e2-67f84e76f9ca could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:34.229848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5dab99eb-29a9-4aa5-b2e1-3ce43fb42a44 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca" status: 404 len: 111 microversion: 2.1 time: 0.035489 Aug 18 21:04:34.229848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 494/993] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:34 2022] GET /compute/v2.1/servers/b369215c-2bbc-48a0-83e2-67f84e76f9ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:35.523087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:35.523973 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:35.531127 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.531700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.532209 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.533040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.533536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.534001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.549079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 HTTP/1.1 Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:35.550678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.553469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '64ec55a1-210c-4113-8e6b-26a08a596519'} Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:35.554838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.557417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.560603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:35.560603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6d946362-8393-4673-9e64-82cd40678ee7 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 404 len: 111 microversion: 2.1 time: 0.033685 Aug 18 21:04:35.560603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 500/994] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:04:35 2022] DELETE /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:35.564847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:35.565955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 64ec55a1-210c-4113-8e6b-26a08a596519] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:35.577841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.578681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.579462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.580678 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.581437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.582196 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.609224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 HTTP/1.1 Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:04:35.612224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.614089 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '64ec55a1-210c-4113-8e6b-26a08a596519'} Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:35.615227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. Aug 18 21:04:35.617223 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.618494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance 64ec55a1-210c-4113-8e6b-26a08a596519 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:35.618494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-47954725-dee8-4e97-95d3-314631fc2f67 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519" status: 404 len: 111 microversion: 2.1 time: 0.057169 Aug 18 21:04:35.618494 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 495/995] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:35 2022] GET /compute/v2.1/servers/64ec55a1-210c-4113-8e6b-26a08a596519 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:35.626922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:35.627895 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:35.639856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.640404 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.640906 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.641756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.642351 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.642951 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.660530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 HTTP/1.1 Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:35.662166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.665018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '18708cef-6c64-4887-a36e-5772b2174015'} Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:35.666699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.669783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.672974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:35.672974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-eb054e26-9156-43b8-8765-7e62805039a6 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 404 len: 111 microversion: 2.1 time: 0.041654 Aug 18 21:04:35.672974 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 501/996] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:04:35 2022] DELETE /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:04:35.673384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:35.673525 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: 18708cef-6c64-4887-a36e-5772b2174015] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:35.680163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.680652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.681086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.681793 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:35.682245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:35.682666 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:35.697907 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 HTTP/1.1 Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:04:35.699488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.702705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '18708cef-6c64-4887-a36e-5772b2174015'} Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:35.704274 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. Aug 18 21:04:35.706667 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:35.708936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance 18708cef-6c64-4887-a36e-5772b2174015 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:35.708936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9c6aa8b6-10bb-4e92-806e-41a08c6087d5 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015" status: 404 len: 111 microversion: 2.1 time: 0.031869 Aug 18 21:04:35.708936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 496/997] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:35 2022] GET /compute/v2.1/servers/18708cef-6c64-4887-a36e-5772b2174015 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:04:37.029958 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:37.030775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:37.040898 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:37.046257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:37.046257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:37.046257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:37.046257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:37.046931 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:37.065745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf HTTP/1.1 Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:37.067354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.073551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'a81738bf-5d23-441d-8b75-e66cf5781acf'} Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:37.077359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.080295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.083017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:37.083017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-398a2ac7-0dd2-4760-9f62-c5ffe3c8bcf0 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 404 len: 111 microversion: 2.1 time: 0.045906 Aug 18 21:04:37.083017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 502/998] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:04:37 2022] DELETE /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:37.083527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:37.083527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] [instance: a81738bf-5d23-441d-8b75-e66cf5781acf] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:37.088633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:37.089428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:37.090184 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:37.091412 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:37.092150 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:37.092836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:37.115565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] HTTP exception thrown: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Request method failure captured: Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf HTTP/1.1 Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qbGmhiYe_2XSBIetyF8g3xMJrpkF11eSxi3XohwfaOe8myeEaLUbYGe6f1GidW9p3pp75taC16T8lPJNhp_WObmNImsDeEoS3WylMujkswc3_G2_V5yvmqLMseM6l-kqVPZlr7b92f_cHT6-s3zcIb0B36BbtZsVkF82clW1D7_Bq4 Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:04:37.118120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/abf631fcae584ce1a0b8c26560398cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: abf631fcae584ce1a0b8c26560398cea Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1473408719 Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: b5b5dd3c92034837921826c9b2dea76b Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeNegativeTest-1473408719-project Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.119945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': 'a81738bf-5d23-441d-8b75-e66cf5781acf'} Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:37.120991 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. Aug 18 21:04:37.122675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:37.124080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] Returning 404 to user: Instance a81738bf-5d23-441d-8b75-e66cf5781acf could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:37.124080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e1bac27c-f6d0-4d9a-8b67-8e625ccc9097 tempest-AttachVolumeNegativeTest-1473408719 tempest-AttachVolumeNegativeTest-1473408719-project] 10.222.0.62 "GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf" status: 404 len: 111 microversion: 2.1 time: 0.045635 Aug 18 21:04:37.124080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 497/999] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:37 2022] GET /compute/v2.1/servers/a81738bf-5d23-441d-8b75-e66cf5781acf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:43.098192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-50834761-1a09-4162-8751-7083b62e024b tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Action: 'create', calling method: .version_select at 0x7f8b5a3db700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-201822412"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:43.238304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-532718063", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2088657920", "security_groups": [{"name": "tempest-secgroup-smoke-914677998"}], "block_device_mapping_v2": [{"uuid": "b45f78ad-d097-40b7-a917-4879c831e101", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4a561f3f-ff1c-4783-b0f8-48e566defdc4"}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:43.367721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] validate_networks() for [('4a561f3f-ff1c-4783-b0f8-48e566defdc4', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:04:43.815627 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-50834761-1a09-4162-8751-7083b62e024b tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.850703 Aug 18 21:04:43.816276 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 503/1000] 10.222.0.62 () {60 vars in 1155 bytes} [Thu Aug 18 21:04:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 852 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 21:04:43.829172 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f8c3ef55-a069-4631-8298-68461e580cfe tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a41f790>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:43.872051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:04:43.872748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:04:43.883574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f8c3ef55-a069-4631-8298-68461e580cfe tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6" status: 200 len: 344 microversion: 2.1 time: 0.056604 Aug 18 21:04:43.883574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 504/1001] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:04:43 2022] GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:04:43.884316 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:04:43.884316 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:04:43.884795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:04:43.895467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:43.895959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:43.896955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:43.897690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:43.898148 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:43.898580 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:43.904892 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=61 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:43.917666 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:04:43.922038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for user e9c8beca893f40f08befa76dd712285f and project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:04:43.982856 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:04:43.985483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b45f78ad-d097-40b7-a917-4879c831e101',volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:04:44.455664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f04882c1-5974-4f66-b2b6-dcb03d414428 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.224143 Aug 18 21:04:44.456376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 498/1002] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:04:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1226 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:04:44.468848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-16f51932-eac2-4aaa-ae17-165b72779104 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:44.469521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-16f51932-eac2-4aaa-ae17-165b72779104 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:44.527062 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-16f51932-eac2-4aaa-ae17-165b72779104 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:44.534482 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-16f51932-eac2-4aaa-ae17-165b72779104 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1094 microversion: 2.1 time: 0.070199 Aug 18 21:04:44.535346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 505/1003] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:44 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:44.896224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-68a6b9e5-27f5-46b7-88e6-ef81d6a8dfb6 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a521940>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:44.949350 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-68a6b9e5-27f5-46b7-88e6-ef81d6a8dfb6 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6" status: 200 len: 345 microversion: 2.1 time: 0.057120 Aug 18 21:04:44.949905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 499/1004] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:04:44 2022] GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:44.963296 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-581d1693-e7a2-408a-b6e2-54cc28294b22 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Action: 'create', calling method: .version_select at 0x7f8b5a3d9820>, body: {"snapshot": {"volume_id": "90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-429076045"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:45.398711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-581d1693-e7a2-408a-b6e2-54cc28294b22 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.440020 Aug 18 21:04:45.405159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 506/1005] 10.222.0.62 () {60 vars in 1162 bytes} [Thu Aug 18 21:04:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:04:45.411404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-37aee57b-f220-47b7-b992-f7d649f61e58 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a4f4700>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:45.441345 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-37aee57b-f220-47b7-b992-f7d649f61e58 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 286 microversion: 2.1 time: 0.034777 Aug 18 21:04:45.444830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 500/1006] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:45 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:45.456280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d51dc298-f44e-40e7-b855-9e9acc35fa10 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5adacaf0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:45.489771 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d51dc298-f44e-40e7-b855-9e9acc35fa10 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.040175 Aug 18 21:04:45.490349 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 507/1007] 10.222.0.62 () {58 vars in 1140 bytes} [Thu Aug 18 21:04:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:45.502208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d825df96-d833-490a-8187-b74c5a16af0b tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a521940>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:45.532375 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d825df96-d833-490a-8187-b74c5a16af0b tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 286 microversion: 2.1 time: 0.033998 Aug 18 21:04:45.533133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 501/1008] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:45 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:45.556206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-60e71fb3-c894-49cb-ad00-966d543273fb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:45.556953 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-60e71fb3-c894-49cb-ad00-966d543273fb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:45.612420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-60e71fb3-c894-49cb-ad00-966d543273fb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:45.619730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-60e71fb3-c894-49cb-ad00-966d543273fb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1094 microversion: 2.1 time: 0.068088 Aug 18 21:04:45.620277 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 508/1009] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:45 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:46.546135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-74a94134-61a3-4b96-a0d4-5fed64f3a1e0 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a4031f0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:46.575989 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-74a94134-61a3-4b96-a0d4-5fed64f3a1e0 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 286 microversion: 2.1 time: 0.034023 Aug 18 21:04:46.576777 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 502/1010] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:46 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:46.640932 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:46.641544 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:46.648870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:46.649357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:46.649796 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:46.650540 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:46.651022 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:46.651488 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:46.713105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:46.720783 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-25f4213a-d121-4da5-bd18-75788cdf84f0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1136 microversion: 2.1 time: 0.083842 Aug 18 21:04:46.721362 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 509/1011] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:46 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:47.589603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ef2740ee-7785-427e-86cd-4a8c2c057807 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a4fbaf0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:47.619247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ef2740ee-7785-427e-86cd-4a8c2c057807 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 286 microversion: 2.1 time: 0.034529 Aug 18 21:04:47.619942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 503/1012] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:47 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:04:47.742062 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:47.742748 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:47.749130 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:47.749618 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:47.750059 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:47.750758 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:47.751213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:47.751674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:47.814143 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:47.821795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4351ac5d-4132-4d8c-8b15-df9fd80c6f0b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1136 microversion: 2.1 time: 0.084141 Aug 18 21:04:47.822357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 510/1013] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:47 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:48.634015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-91f2c0a3-1734-4c8d-bdbe-d3ec954c2e1e tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a4ae0d0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:48.664906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-91f2c0a3-1734-4c8d-bdbe-d3ec954c2e1e tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 286 microversion: 2.1 time: 0.035220 Aug 18 21:04:48.665472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 504/1014] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:48 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:48.842342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:48.842980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:48.849549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:48.850074 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:48.851078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:48.851823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:48.852279 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:48.852711 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:48.917674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:48.925489 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1ed98e11-054a-4042-a6b1-a4f059edf1bd tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1192 microversion: 2.1 time: 0.087055 Aug 18 21:04:48.926063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 511/1015] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:48 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:49.678818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-64a40320-2432-41ec-8506-204636c9af44 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a51f9d0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:49.711214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-64a40320-2432-41ec-8506-204636c9af44 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 286 microversion: 2.1 time: 0.036839 Aug 18 21:04:49.711909 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 505/1016] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:49 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:49.947685 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:49.948368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:49.956168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:49.956661 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:49.957115 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:49.957858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:49.958320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:49.958782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:50.060644 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:50.069898 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c0dd072c-541e-4513-818b-35f943005b62 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1210 microversion: 2.1 time: 0.126366 Aug 18 21:04:50.070479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 512/1017] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:49 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:50.725024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f420b066-2216-418a-a624-cb2abfd0c5f4 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a3d99d0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:50.760242 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f420b066-2216-418a-a624-cb2abfd0c5f4 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 287 microversion: 2.1 time: 0.039447 Aug 18 21:04:50.766769 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 506/1018] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:50 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:04:50.775792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-814c0387-6b14-4e84-9efe-7051f48b42bb tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a3dbb80>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:50.938899 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-814c0387-6b14-4e84-9efe-7051f48b42bb tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 202 len: 0 microversion: 2.1 time: 0.166179 Aug 18 21:04:50.938899 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 513/1019] 10.222.0.62 () {58 vars in 1254 bytes} [Thu Aug 18 21:04:50 2022] DELETE /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 21:04:50.945349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f5e339fe-a5f8-49ab-93f3-ac52a76cf4ec tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a439040>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:50.980050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f5e339fe-a5f8-49ab-93f3-ac52a76cf4ec tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 200 len: 286 microversion: 2.1 time: 0.039316 Aug 18 21:04:50.980710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 507/1020] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:50 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:51.092601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:51.093350 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:51.099727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:51.100269 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:51.101426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:51.102298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:51.102766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:51.103201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:51.337477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:51.345893 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-629c1dc9-62d0-4dbe-ae59-f94413bade0d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1277 microversion: 2.1 time: 0.258007 Aug 18 21:04:51.346466 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 514/1021] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:51 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:51.720777 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-a0444979-f45d-4f5f-9f48-1ad9fe4d78f2 req-b601310e-9984-4ce2-a4f9-31483bbdc361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e799d4da-faeb-4a1e-9014-d742d8218de1", "tag": "84e33ea0-ae3b-4e20-a443-e04b7511d9b3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:04:51.731207 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a0444979-f45d-4f5f-9f48-1ad9fe4d78f2 req-b601310e-9984-4ce2-a4f9-31483bbdc361 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:51.731945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a0444979-f45d-4f5f-9f48-1ad9fe4d78f2 req-b601310e-9984-4ce2-a4f9-31483bbdc361 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:51.732282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a0444979-f45d-4f5f-9f48-1ad9fe4d78f2 req-b601310e-9984-4ce2-a4f9-31483bbdc361 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:51.744826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-a0444979-f45d-4f5f-9f48-1ad9fe4d78f2 req-b601310e-9984-4ce2-a4f9-31483bbdc361 service nova] Creating event network-changed:84e33ea0-ae3b-4e20-a443-e04b7511d9b3 for instance e799d4da-faeb-4a1e-9014-d742d8218de1 on hv-cinder-85265 Aug 18 21:04:51.750181 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-a0444979-f45d-4f5f-9f48-1ad9fe4d78f2 req-b601310e-9984-4ce2-a4f9-31483bbdc361 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033273 Aug 18 21:04:51.750790 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 508/1022] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:51.995509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f4ab43dd-7b1f-49c4-b06b-12b6b6f2f566 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a5448b0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:52.021134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-f4ab43dd-7b1f-49c4-b06b-12b6b6f2f566 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] HTTP exception thrown: Snapshot c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e could not be found. Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f4ab43dd-7b1f-49c4-b06b-12b6b6f2f566 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Request method failure captured: Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e HTTP/1.1 Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qlqSDrjWwHZuAwrwLGbvaZp1qNsFRRIIeRvOrXqbG6las3ELMKUsmrjVwHeM_EMkSIZ_3JelQwSUis3Nkqqs4UorD-7rjE7HSN2QGItB6k-RCAjoxyxky0RjIj9SLjqpZhcewwbGwDMGNxtg-M88Ya7J6LETjYwbRptw9IczZoBWmE Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:52.023456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c3e8a5687fa544fe85761a5042186888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 48326ec735f547d592fed6c4dd6ed88a Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Snapshot c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e could not be found. Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e'} Aug 18 21:04:52.025192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e could not be found. (HTTP 404) (Request-ID: req-b2a1631f-fff2-4edd-9db4-c6ccdf6f1b73) Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:52.026342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 21:04:52.027700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e could not be found. Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 21:04:52.029168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e could not be found. Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e could not be found. Aug 18 21:04:52.030666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:52.033017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f4ab43dd-7b1f-49c4-b06b-12b6b6f2f566 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Returning 404 to user: Snapshot c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:52.033890 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f4ab43dd-7b1f-49c4-b06b-12b6b6f2f566 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e" status: 404 len: 111 microversion: 2.1 time: 0.043403 Aug 18 21:04:52.034462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 515/1023] 10.222.0.62 () {58 vars in 1251 bytes} [Thu Aug 18 21:04:51 2022] GET /compute/v2.1/os-snapshots/c702e4a0-1bd1-4c7d-bd3c-ffbd90880c9e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:52.044213 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7036cc1b-0eea-4c97-a877-a68076bfcf0f tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a6bc040>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:52.251389 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7036cc1b-0eea-4c97-a877-a68076bfcf0f tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6" status: 202 len: 0 microversion: 2.1 time: 0.211220 Aug 18 21:04:52.252265 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 509/1024] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 21:04:52 2022] DELETE /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:04:52.260882 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f9e72138-a2aa-494d-880c-290581208684 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a56f550>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:52.314250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f9e72138-a2aa-494d-880c-290581208684 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6" status: 200 len: 344 microversion: 2.1 time: 0.057713 Aug 18 21:04:52.315780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 516/1025] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:04:52 2022] GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:04:52.366562 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:52.367302 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:52.373681 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:52.374170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:52.374608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:52.375340 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:52.375802 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:52.376226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:52.545970 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:52.554035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1b82d5f8-3fc1-4dba-906a-5849e5e14fcb tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.191276 Aug 18 21:04:52.554608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 510/1026] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:52 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:53.328938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-58291a3c-4273-427b-971a-94475881e60a tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a228430>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:53.356835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-58291a3c-4273-427b-971a-94475881e60a tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] HTTP exception thrown: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-58291a3c-4273-427b-971a-94475881e60a tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Request method failure captured: Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 HTTP/1.1 Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qlqSDrjWwHZuAwrwLGbvaZp1qNsFRRIIeRvOrXqbG6las3ELMKUsmrjVwHeM_EMkSIZ_3JelQwSUis3Nkqqs4UorD-7rjE7HSN2QGItB6k-RCAjoxyxky0RjIj9SLjqpZhcewwbGwDMGNxtg-M88Ya7J6LETjYwbRptw9IczZoBWmE Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:53.358804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c3e8a5687fa544fe85761a5042186888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 48326ec735f547d592fed6c4dd6ed88a Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6'} Aug 18 21:04:53.360538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. (HTTP 404) (Request-ID: req-5486af31-149d-45a9-bfb2-8eb361df5d12) Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.361474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 21:04:53.362752 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 21:04:53.363991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-58291a3c-4273-427b-971a-94475881e60a tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Returning 404 to user: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-58291a3c-4273-427b-971a-94475881e60a tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6" status: 404 len: 109 microversion: 2.1 time: 0.035642 Aug 18 21:04:53.365322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 517/1027] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:04:53 2022] GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:04:53.375061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a151b580-dea2-4005-93b4-ebcca6528124 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a6bc040>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:53.403916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-a151b580-dea2-4005-93b4-ebcca6528124 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] HTTP exception thrown: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a151b580-dea2-4005-93b4-ebcca6528124 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Request method failure captured: Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: DELETE /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 HTTP/1.1 Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qlqSDrjWwHZuAwrwLGbvaZp1qNsFRRIIeRvOrXqbG6las3ELMKUsmrjVwHeM_EMkSIZ_3JelQwSUis3Nkqqs4UorD-7rjE7HSN2QGItB6k-RCAjoxyxky0RjIj9SLjqpZhcewwbGwDMGNxtg-M88Ya7J6LETjYwbRptw9IczZoBWmE Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:04:53.406067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c3e8a5687fa544fe85761a5042186888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 48326ec735f547d592fed6c4dd6ed88a Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6'} Aug 18 21:04:53.407880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. (HTTP 404) (Request-ID: req-7f6f0c77-a361-4d41-a365-23d9873f444f) Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.409452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 21:04:53.411201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 21:04:53.413140 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a151b580-dea2-4005-93b4-ebcca6528124 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Returning 404 to user: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:53.414712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a151b580-dea2-4005-93b4-ebcca6528124 tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6" status: 404 len: 109 microversion: 2.1 time: 0.036374 Aug 18 21:04:53.415748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 511/1028] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 21:04:53 2022] DELETE /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:53.417028 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cf04c4e8-f359-4ead-951c-7461610df37d tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Calling method '.version_select at 0x7f8b5a56f310>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:53.447558 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-cf04c4e8-f359-4ead-951c-7461610df37d tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] HTTP exception thrown: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cf04c4e8-f359-4ead-951c-7461610df37d tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Request method failure captured: Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 HTTP/1.1 Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qlqSDrjWwHZuAwrwLGbvaZp1qNsFRRIIeRvOrXqbG6las3ELMKUsmrjVwHeM_EMkSIZ_3JelQwSUis3Nkqqs4UorD-7rjE7HSN2QGItB6k-RCAjoxyxky0RjIj9SLjqpZhcewwbGwDMGNxtg-M88Ya7J6LETjYwbRptw9IczZoBWmE Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:04:53.451155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c3e8a5687fa544fe85761a5042186888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c3e8a5687fa544fe85761a5042186888"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: c3e8a5687fa544fe85761a5042186888 Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1662042501 Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 48326ec735f547d592fed6c4dd6ed88a Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1662042501-project Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6'} Aug 18 21:04:53.454718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. (HTTP 404) (Request-ID: req-5c1654f0-a96d-40bf-ac55-5d5a729433fe) Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.456017 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 21:04:53.457384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 21:04:53.459001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cf04c4e8-f359-4ead-951c-7461610df37d tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] Returning 404 to user: Volume 90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cf04c4e8-f359-4ead-951c-7461610df37d tempest-VolumesSnapshotsTestJSON-1662042501 tempest-VolumesSnapshotsTestJSON-1662042501-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6" status: 404 len: 109 microversion: 2.1 time: 0.038384 Aug 18 21:04:53.460802 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 518/1029] 10.222.0.62 () {58 vars in 1245 bytes} [Thu Aug 18 21:04:53 2022] GET /compute/v2.1/os-volumes/90d9061e-b4c6-4f4e-b2f4-a2bbf0b8d6c6 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:04:53.588462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:53.589192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:53.596428 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:53.596920 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:53.597357 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:53.598073 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:53.598530 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:53.598953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:53.746263 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:53.754598 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3349d3b0-91e5-4b78-bc4a-3bd37de407a0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.170640 Aug 18 21:04:53.755198 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 512/1030] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:53 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:54.777400 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:54.778610 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:54.780645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:54.786245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:54.786738 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:54.787178 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:54.788573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:54.792955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:54.792955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:54.792955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:54.942118 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:54.950543 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6a111cba-d16f-4f62-9b3c-f443c336c179 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.177557 Aug 18 21:04:54.951174 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 519/1031] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:54 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:55.972161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:55.973044 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:55.975624 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:55.976320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:55.982045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:55.982597 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:55.983043 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:55.983775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:55.984254 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:55.984680 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:56.126692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:56.134607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f08a30c0-9501-4866-9b31-c74506a1d5fc tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.166378 Aug 18 21:04:56.135189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 513/1032] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:55 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:57.156745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:57.157337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:57.159289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=4 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:57.165403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:57.165891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:57.166333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:57.167042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:57.167545 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:57.167975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:57.322091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:57.330833 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ec91d8cd-fdf0-41ff-be7c-396de4fd5a56 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.178705 Aug 18 21:04:57.331427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 520/1033] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:57 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:04:58.353628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:58.354262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:58.356917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:58.362348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:58.362847 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:58.363286 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:58.364233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:58.364861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:58.365299 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:58.512349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:58.526887 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7d4f1bdf-0cad-42b9-a1f5-b3b28ec6da97 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.178142 Aug 18 21:04:58.527504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 514/1034] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:58 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:04:59.549051 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:04:59.549659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:04:59.556491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:59.556979 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:59.557412 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:59.558111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:04:59.558556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:04:59.558981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:04:59.705052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:04:59.713804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-041f39f9-3ce6-40f7-9fc3-af56546f646e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.168724 Aug 18 21:04:59.714403 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 521/1035] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:04:59 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:00.735116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:00.736555 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:00.744971 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:00.746209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:00.746649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:00.748126 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:00.749055 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:00.749487 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:00.890171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:00.899641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-95a1857a-712d-4486-85fa-59c745130b68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.168727 Aug 18 21:05:00.900226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 515/1036] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:00 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:01.921253 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:01.921836 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:01.931047 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:01.936060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:01.936060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:01.936060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:01.936060 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:01.936481 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:02.078697 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:02.086641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-aaf6c167-7d94-4ca7-89fc-87ffb1d4b5b5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.169425 Aug 18 21:05:02.087213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 522/1037] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:01 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:03.108016 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:03.108652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:03.115127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:03.115651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:03.116088 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:03.116791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:03.117828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:03.118256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:03.251836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:03.260054 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0003b9b7-22ca-4875-9bde-3687770937a6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.155883 Aug 18 21:05:03.260622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 516/1038] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:03 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:04.280406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:04.281040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:04.287731 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:04.288217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:04.288689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:04.289925 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:04.290375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:04.290800 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:04.426695 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:04.434957 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2daff9c4-8aaa-45db-97e8-b9e6a33064f3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.158406 Aug 18 21:05:04.435552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 523/1039] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:04 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:05.468821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:05.469236 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:05.475385 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:05.475915 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:05.476351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:05.477259 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:05.477718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:05.478155 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:05.629506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:05.651462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0bbd726a-0f46-4175-b4b8-85ecd2f828c0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.187113 Aug 18 21:05:05.652554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 517/1040] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:05 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:05.786267 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-01b62cbe-450c-404c-bef6-7513cdac5aa5 req-383d9159-4a1d-4c1d-a3b2-f1610112dece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e799d4da-faeb-4a1e-9014-d742d8218de1", "name": "network-vif-plugged", "status": "completed", "tag": "84e33ea0-ae3b-4e20-a443-e04b7511d9b3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:05:05.796786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-01b62cbe-450c-404c-bef6-7513cdac5aa5 req-383d9159-4a1d-4c1d-a3b2-f1610112dece service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:05.797352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-01b62cbe-450c-404c-bef6-7513cdac5aa5 req-383d9159-4a1d-4c1d-a3b2-f1610112dece service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:05.797857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-01b62cbe-450c-404c-bef6-7513cdac5aa5 req-383d9159-4a1d-4c1d-a3b2-f1610112dece service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:05.809625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-01b62cbe-450c-404c-bef6-7513cdac5aa5 req-383d9159-4a1d-4c1d-a3b2-f1610112dece service nova] Creating event network-vif-plugged:84e33ea0-ae3b-4e20-a443-e04b7511d9b3 for instance e799d4da-faeb-4a1e-9014-d742d8218de1 on hv-cinder-85265 Aug 18 21:05:05.815383 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-01b62cbe-450c-404c-bef6-7513cdac5aa5 req-383d9159-4a1d-4c1d-a3b2-f1610112dece service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179078 Aug 18 21:05:05.816005 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 524/1041] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:05:06.690606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:06.691139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:06.698306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:06.701414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:06.701414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:06.701414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:06.701414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:06.701830 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:07.072792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:07.080817 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e6cde84c-73b8-43a7-9cec-e3b44bdb6be6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.394146 Aug 18 21:05:07.081559 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 518/1042] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:06 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:05:08.104552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:08.105303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:08.112179 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:08.115322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:08.115322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:08.115322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:08.115322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:08.115810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:08.267745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:08.277206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-35a871f8-0fb5-469f-8860-60e8b265716d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1265 microversion: 2.1 time: 0.177997 Aug 18 21:05:08.277860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 525/1043] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:08 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:09.299285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:09.299924 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:09.307306 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:09.307818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:09.308294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:09.308952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:09.309522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:09.309807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:09.478106 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:09.485952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3d3ec84c-ad51-4d53-bc9a-0a9ea5a2c934 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1453 microversion: 2.1 time: 0.190486 Aug 18 21:05:09.486516 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 519/1044] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:09 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:09.506449 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:09.507111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:09.514288 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:09.514772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:09.520775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:09.520775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:09.520775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:09.520775 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:09.657625 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:09.666038 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0fca6e5c-f389-40d1-81dc-6cb7c0e54ed6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1453 microversion: 2.1 time: 0.163345 Aug 18 21:05:09.666961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 526/1045] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:09 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:12.435326 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-dbb30839-cb50-4e40-ac35-a47c2c35cde5 req-09f99079-7dd6-413a-b436-d37a097ee804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e799d4da-faeb-4a1e-9014-d742d8218de1", "tag": "84e33ea0-ae3b-4e20-a443-e04b7511d9b3"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:05:12.445684 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-dbb30839-cb50-4e40-ac35-a47c2c35cde5 req-09f99079-7dd6-413a-b436-d37a097ee804 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:12.446165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-dbb30839-cb50-4e40-ac35-a47c2c35cde5 req-09f99079-7dd6-413a-b436-d37a097ee804 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:12.446598 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-dbb30839-cb50-4e40-ac35-a47c2c35cde5 req-09f99079-7dd6-413a-b436-d37a097ee804 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:12.470063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-dbb30839-cb50-4e40-ac35-a47c2c35cde5 req-09f99079-7dd6-413a-b436-d37a097ee804 service nova] Creating event network-changed:84e33ea0-ae3b-4e20-a443-e04b7511d9b3 for instance e799d4da-faeb-4a1e-9014-d742d8218de1 on hv-cinder-85265 Aug 18 21:05:12.476401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-dbb30839-cb50-4e40-ac35-a47c2c35cde5 req-09f99079-7dd6-413a-b436-d37a097ee804 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262405 Aug 18 21:05:12.477051 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 520/1046] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:05:23.149639 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:23.151841 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:23.154156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=15 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:23.154815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=43 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:23.166219 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:23.166709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:23.167193 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:23.167894 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:23.168347 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:23.168852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:23.200411 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-55927e8e-0c14-4dab-8da2-c5391b095028 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055158 Aug 18 21:05:23.200993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 527/1047] 10.222.0.62 () {60 vars in 1343 bytes} [Thu Aug 18 21:05:23 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:23.275409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:23.276040 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:23.278526 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=13 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:23.279174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=59 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:23.284330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:23.284815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:23.285239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:23.286214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:23.286660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:23.287080 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:23.315258 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Going to try to terminate instance {{(pid=127937) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:05:23.629933 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9b3c6967-ad2c-4181-8ccf-4d2ddee7cd62 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 204 len: 0 microversion: 2.20 time: 0.358940 Aug 18 21:05:23.630441 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 521/1048] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Aug 18 21:05:23 2022] DELETE /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 21:05:23.639257 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:23.639905 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:23.646294 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:23.646788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:23.647223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:23.648022 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:23.648477 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:23.648904 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:23.796676 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:23.805442 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:23.806957 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:23.808184 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e092dad2-552a-4e3d-b75e-dbd42bb21a71 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.172989 Aug 18 21:05:23.808788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 528/1049] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:05:23 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:05:24.833079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:24.834208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:24.841955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:24.842448 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:24.842894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:24.843649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:24.844107 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:24.844535 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:25.019635 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:25.033083 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:25.034657 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:25.036233 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9ea87c93-8e9c-424d-8db4-a1a5780de9c4 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.208717 Aug 18 21:05:25.037848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 522/1050] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:05:24 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:05:26.070092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:26.072440 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:26.086652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:26.087615 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:26.088431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:26.089518 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:26.090393 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:26.091015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:26.384454 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:26.395302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:26.399201 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:26.411836 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3b36cbe2-d7f3-4e4a-8f48-b291981ca7cc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1725 microversion: 2.20 time: 0.348926 Aug 18 21:05:26.413886 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 529/1051] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:05:26 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1725 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:05:27.035243 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-7c886f27-63c3-48c7-a1c5-ba99d4d1a54e req-876e1b97-6253-41d0-a43c-a33b28157bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e18af4-e43d-4a3e-8927-934dd31062c1", "name": "network-vif-deleted", "tag": "325a8ac4-261b-41ac-a3ca-a40a5b74b70f"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:05:27.057383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-7c886f27-63c3-48c7-a1c5-ba99d4d1a54e req-876e1b97-6253-41d0-a43c-a33b28157bd3 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:27.058859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-7c886f27-63c3-48c7-a1c5-ba99d4d1a54e req-876e1b97-6253-41d0-a43c-a33b28157bd3 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:27.059712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-7c886f27-63c3-48c7-a1c5-ba99d4d1a54e req-876e1b97-6253-41d0-a43c-a33b28157bd3 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:27.081832 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-7c886f27-63c3-48c7-a1c5-ba99d4d1a54e req-876e1b97-6253-41d0-a43c-a33b28157bd3 service nova] Creating event network-vif-deleted:325a8ac4-261b-41ac-a3ca-a40a5b74b70f for instance 93e18af4-e43d-4a3e-8927-934dd31062c1 on hv-cinder-85265 Aug 18 21:05:27.089034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-7c886f27-63c3-48c7-a1c5-ba99d4d1a54e req-876e1b97-6253-41d0-a43c-a33b28157bd3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061996 Aug 18 21:05:27.090967 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 523/1052] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:05:27.453488 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:27.454233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:27.462499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:27.462997 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:27.463694 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:27.464456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:27.465116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:27.465762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:27.504769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:27.505271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:27.505722 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:27.506423 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lazy-loading 'fault' on Instance uuid 93e18af4-e43d-4a3e-8927-934dd31062c1 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:05:27.572761 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:27.589649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:27.593467 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cf3712f97958438581b8e153723a1d71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4600f776fb78446ab25a3ee913934fcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:27.595991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-773ffdeb-9996-4a4b-bb63-9cee3470b23f tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 200 len: 1371 microversion: 2.20 time: 0.146214 Aug 18 21:05:27.597205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 530/1053] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:05:27 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:05:28.637336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:28.638226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:28.645141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:28.645632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:28.646093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:28.646795 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:28.647244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:28.647743 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:28.665622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] HTTP exception thrown: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Request method failure captured: Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 HTTP/1.1 Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qc9UFqLkRA93pAKXKk4NKPKmQx5GNXps1UWqo2UfCz860MmP2FBFBIU4dRI8S8425J9QAZ0dZCFgfWXUv4fODy_0otgITy2R9JcEGsBd-yPnXJJAxRpzcF0XMbWfCerM6akSNg3Vs0x8XNcIGV3wsIds4Av1YwQ5gZAH8Z5O8ohPUI Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:05:28.667317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: cf3712f97958438581b8e153723a1d71 Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:28.670245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '93e18af4-e43d-4a3e-8927-934dd31062c1'} Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:05:28.671785 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:28.674488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:28.677374 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Returning 404 to user: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:05:28.677374 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-807c83fd-9a1d-49f5-9261-695c4566010d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 404 len: 111 microversion: 2.20 time: 0.037313 Aug 18 21:05:28.677374 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 524/1054] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:05:28 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 21:05:28.680943 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1b3d71a3-1ef6-4cdb-afd1-272111470b41 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '.version_select at 0x7f8b5a239160>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:28.811488 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1b3d71a3-1ef6-4cdb-afd1-272111470b41 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491249910" status: 204 len: 0 microversion: 2.20 time: 0.136401 Aug 18 21:05:28.812485 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 531/1055] 10.222.0.62 () {60 vars in 1262 bytes} [Thu Aug 18 21:05:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1491249910 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 21:05:31.202837 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:31.203741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:31.212853 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:31.213489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:31.214066 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:31.214905 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:31.215488 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:31.215972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:31.232472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] HTTP exception thrown: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Request method failure captured: Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: DELETE /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 HTTP/1.1 Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qc9UFqLkRA93pAKXKk4NKPKmQx5GNXps1UWqo2UfCz860MmP2FBFBIU4dRI8S8425J9QAZ0dZCFgfWXUv4fODy_0otgITy2R9JcEGsBd-yPnXJJAxRpzcF0XMbWfCerM6akSNg3Vs0x8XNcIGV3wsIds4Av1YwQ5gZAH8Z5O8ohPUI Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:05:31.234436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: cf3712f97958438581b8e153723a1d71 Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.236296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '93e18af4-e43d-4a3e-8927-934dd31062c1'} Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:05:31.237262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.239020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.240739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Returning 404 to user: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:05:31.240739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-52f3a48d-8217-4800-b8f4-2d3708b33b6d tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 404 len: 111 microversion: 2.20 time: 0.042171 Aug 18 21:05:31.240739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 525/1056] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Aug 18 21:05:31 2022] DELETE /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 21:05:31.251922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:31.253005 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 93e18af4-e43d-4a3e-8927-934dd31062c1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:31.264108 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:31.264948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:31.266235 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:31.266890 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:31.267727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:31.268476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:31.295028 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] HTTP exception thrown: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Request method failure captured: Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 HTTP/1.1 Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qc9UFqLkRA93pAKXKk4NKPKmQx5GNXps1UWqo2UfCz860MmP2FBFBIU4dRI8S8425J9QAZ0dZCFgfWXUv4fODy_0otgITy2R9JcEGsBd-yPnXJJAxRpzcF0XMbWfCerM6akSNg3Vs0x8XNcIGV3wsIds4Av1YwQ5gZAH8Z5O8ohPUI Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:05:31.298476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cf3712f97958438581b8e153723a1d71 Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.300993 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '93e18af4-e43d-4a3e-8927-934dd31062c1'} Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:05:31.302368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. Aug 18 21:05:31.304726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:31.307213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Returning 404 to user: Instance 93e18af4-e43d-4a3e-8927-934dd31062c1 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:05:31.307213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-68fe4a8b-f7bc-452c-98a8-9807a9dfd799 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1" status: 404 len: 111 microversion: 2.20 time: 0.056970 Aug 18 21:05:31.307213 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 532/1057] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:05:31 2022] GET /compute/v2.1/servers/93e18af4-e43d-4a3e-8927-934dd31062c1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 21:05:32.617261 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:32.617890 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:32.624484 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:32.627883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:32.627883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:32.627883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:32.627883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:32.628288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:32.641720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] HTTP exception thrown: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Request method failure captured: Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: DELETE /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 HTTP/1.1 Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qc9UFqLkRA93pAKXKk4NKPKmQx5GNXps1UWqo2UfCz860MmP2FBFBIU4dRI8S8425J9QAZ0dZCFgfWXUv4fODy_0otgITy2R9JcEGsBd-yPnXJJAxRpzcF0XMbWfCerM6akSNg3Vs0x8XNcIGV3wsIds4Av1YwQ5gZAH8Z5O8ohPUI Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:05:32.645211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: cf3712f97958438581b8e153723a1d71 Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.647333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '36c76af8-35e8-4dbe-885d-cb5510af2411'} Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:05:32.648960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.650665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.652402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Returning 404 to user: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:05:32.652402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0dd79f9d-1642-496c-a68b-7340106a8f96 tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "DELETE /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 404 len: 111 microversion: 2.20 time: 0.031533 Aug 18 21:05:32.652402 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 526/1058] 10.222.0.62 () {60 vars in 1280 bytes} [Thu Aug 18 21:05:32 2022] DELETE /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 21:05:32.654176 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:32.654794 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] [instance: 36c76af8-35e8-4dbe-885d-cb5510af2411] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:32.661663 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:32.662331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:32.662578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:32.663304 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:32.663780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:32.664204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:32.679745 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] HTTP exception thrown: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Request method failure captured: Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 HTTP/1.1 Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qc9UFqLkRA93pAKXKk4NKPKmQx5GNXps1UWqo2UfCz860MmP2FBFBIU4dRI8S8425J9QAZ0dZCFgfWXUv4fODy_0otgITy2R9JcEGsBd-yPnXJJAxRpzcF0XMbWfCerM6akSNg3Vs0x8XNcIGV3wsIds4Av1YwQ5gZAH8Z5O8ohPUI Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:05:32.681217 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4600f776fb78446ab25a3ee913934fcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 4600f776fb78446ab25a3ee913934fcc Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-28527255 Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: cf3712f97958438581b8e153723a1d71 Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeShelveTestJSON-28527255-project Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.687378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '36c76af8-35e8-4dbe-885d-cb5510af2411'} Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:05:32.688337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. Aug 18 21:05:32.690541 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:05:32.691937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] Returning 404 to user: Instance 36c76af8-35e8-4dbe-885d-cb5510af2411 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:05:32.691937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4c60cafa-38be-4198-865c-a0b27dee85fc tempest-AttachVolumeShelveTestJSON-28527255 tempest-AttachVolumeShelveTestJSON-28527255-project] 10.222.0.62 "GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411" status: 404 len: 111 microversion: 2.20 time: 0.032361 Aug 18 21:05:32.691937 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 533/1059] 10.222.0.62 () {60 vars in 1277 bytes} [Thu Aug 18 21:05:32 2022] GET /compute/v2.1/servers/36c76af8-35e8-4dbe-885d-cb5510af2411 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 21:05:45.676091 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:45.677061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:45.852754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d08ab4d7-7ce8-49fe-b2eb-435034a13fd1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'create', calling method: .version_select at 0x7f8b5c928ca0>, body: {"keypair": {"name": "tempest-keypair-92848817", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzP2usGShuBtgDRIXMDP6sHPcVPG3C4BYHzucyDY5ryrcZZ3i1DVKpN/Wi+xIUdh0sHotiRD/t7rF3ORfiQcQVeKpDq7DcVAk5MUxl6QmyXCHJG596eD7NTgDcaY3D3TQ=="}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:05:45.876461 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-d08ab4d7-7ce8-49fe-b2eb-435034a13fd1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for project 5d218206dcfd460a93035144c44ec2f6. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:05:45.882910 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-d08ab4d7-7ce8-49fe-b2eb-435034a13fd1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for user 48e346f5fa354c7cb5b83540c8b36531 and project 5d218206dcfd460a93035144c44ec2f6. Resources: {'key_pairs'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:05:45.992239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d08ab4d7-7ce8-49fe-b2eb-435034a13fd1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.321769 Aug 18 21:05:45.994134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 527/1060] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 21:05:45 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:05:49.118637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1619562432", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e317b70-c291-4424-b79c-bfd4fcabbab6"}], "security_groups": [{"name": "tempest-securitygroup--523463885"}], "key_name": "tempest-keypair-92848817", "user_data": "}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:05:49.127558 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:49.128232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=30 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:49.250468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.network.neutron [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] validate_networks() for [('1e317b70-c291-4424-b79c-bfd4fcabbab6', None, None, None, None, None)] {{(pid=127936) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:05:49.780995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Flavor limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:05:49.781662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Image limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:05:49.782438 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Flavor pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:05:49.783013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Image pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:05:49.783643 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:05:49.798011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:49.800734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:49.800734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:49.800734 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:49.801414 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:49.801659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:49.841760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for project 5d218206dcfd460a93035144c44ec2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:05:49.847568 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for user 48e346f5fa354c7cb5b83540c8b36531 and project 5d218206dcfd460a93035144c44ec2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:05:49.863274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Going to run 1 instances... {{(pid=127936) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:05:49.866320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127936) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:05:49.995747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-db8e8810-04a7-4245-adef-76d7f8ff869f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.883821 Aug 18 21:05:49.996386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 534/1061] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:05:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:05:50.012511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a8c48874-8fd9-4e3e-b53b-cd684543079b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:50.013328 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a8c48874-8fd9-4e3e-b53b-cd684543079b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:50.079298 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a8c48874-8fd9-4e3e-b53b-cd684543079b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:50.086565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a8c48874-8fd9-4e3e-b53b-cd684543079b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1236 microversion: 2.1 time: 0.079073 Aug 18 21:05:50.087128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 528/1062] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:50 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:51.108025 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-827d45f4-12b4-4c88-87bb-ad4e60fcfac8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:51.108608 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-827d45f4-12b4-4c88-87bb-ad4e60fcfac8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:51.166634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-827d45f4-12b4-4c88-87bb-ad4e60fcfac8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:51.174084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-827d45f4-12b4-4c88-87bb-ad4e60fcfac8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1236 microversion: 2.1 time: 0.070634 Aug 18 21:05:51.174657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 535/1063] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:51 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:52.196834 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:52.197468 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:52.204150 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:52.204631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:52.205064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:52.205764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:52.206208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:52.206624 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:52.275798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:52.283770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-68bfddf2-d4e8-4e6b-8254-7b3ef5260895 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1288 microversion: 2.1 time: 0.091238 Aug 18 21:05:52.284341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 529/1064] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:52 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:53.312328 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:53.321731 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:53.322624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:53.323139 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:53.323626 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:53.324369 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:53.326245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:53.326685 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:53.543052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:53.553437 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7257765a-3057-437b-9913-a2648f0dde5a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.246736 Aug 18 21:05:53.554318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 536/1065] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:53 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:54.193945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-20b9246a-4c77-4c62-a931-f095381d9e49 req-b8ec9d01-3e6f-43a7-95ed-6005dc93be4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb392ede-a875-4d9d-92e6-f2470fd58a68", "tag": "4c629978-1996-4de4-8529-a241038026a0"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:05:54.213342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-20b9246a-4c77-4c62-a931-f095381d9e49 req-b8ec9d01-3e6f-43a7-95ed-6005dc93be4d service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:54.214824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-20b9246a-4c77-4c62-a931-f095381d9e49 req-b8ec9d01-3e6f-43a7-95ed-6005dc93be4d service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:54.215276 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-20b9246a-4c77-4c62-a931-f095381d9e49 req-b8ec9d01-3e6f-43a7-95ed-6005dc93be4d service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:54.227924 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-20b9246a-4c77-4c62-a931-f095381d9e49 req-b8ec9d01-3e6f-43a7-95ed-6005dc93be4d service nova] Creating event network-changed:4c629978-1996-4de4-8529-a241038026a0 for instance cb392ede-a875-4d9d-92e6-f2470fd58a68 on hv-cinder-85265 Aug 18 21:05:54.233554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-20b9246a-4c77-4c62-a931-f095381d9e49 req-b8ec9d01-3e6f-43a7-95ed-6005dc93be4d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043516 Aug 18 21:05:54.234790 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 530/1066] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:05:54.577797 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:54.578961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:54.591524 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:54.592207 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:54.593037 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:54.594298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:54.595122 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:54.595925 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:54.868111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:54.877412 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-43ea9eac-3c00-4fef-8d1f-d317571a4f10 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.306589 Aug 18 21:05:54.878343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 537/1067] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:54 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:55.902267 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:55.903039 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:55.909784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:55.910281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:55.910720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:55.911744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:55.912205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:55.913157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:56.071653 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:56.083787 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f9ec430c-09f0-4970-8cd4-78626eed9092 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.186141 Aug 18 21:05:56.084918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 531/1068] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:55 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:57.105498 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:57.106111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:57.112486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:57.112964 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:57.113399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:57.114093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:57.114538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:57.114954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:57.247056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:57.255214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dabdc363-97c7-462c-8b80-eb71b3f29086 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.153593 Aug 18 21:05:57.255870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 538/1069] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:57 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:58.276156 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:58.276994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:58.283283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:58.283799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:58.284231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:58.284920 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:58.285400 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:58.285818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:58.434663 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:58.443903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7bf60692-fbe1-4301-86dd-21a1012975d6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.171205 Aug 18 21:05:58.445060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 532/1070] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:58 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:05:59.466469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:05:59.467097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:05:59.473846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:59.474370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:59.474878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:59.475631 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:05:59.476090 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:05:59.476519 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:05:59.621307 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:05:59.630149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-11938b3d-5b4d-4674-8439-775013bc3668 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.167737 Aug 18 21:05:59.630732 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 539/1071] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:05:59 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:00.653549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:00.660466 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:00.660466 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:00.662125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:00.662641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:00.663090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:00.663836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:00.664297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:00.664729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:00.808662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:00.816527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c270cce8-2c00-4b42-9e71-ff6ba605b824 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.166968 Aug 18 21:06:00.817142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 533/1072] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:00 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:01.839340 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:01.840087 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:01.841797 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:01.842968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=8 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:01.847831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:01.848321 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:01.848768 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:01.849603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:01.850101 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:01.850533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:02.023561 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:02.033709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-abbfd4e3-e8b6-471f-8606-e7eda7ea509c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.199243 Aug 18 21:06:02.034391 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 540/1073] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:01 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:06:02.142624 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-2b29ed8b-e6cd-4649-8478-ed44b52215b8 req-12580982-155f-483e-801c-7d2c0a214674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb392ede-a875-4d9d-92e6-f2470fd58a68", "name": "network-vif-plugged", "status": "completed", "tag": "4c629978-1996-4de4-8529-a241038026a0"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:06:02.153633 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2b29ed8b-e6cd-4649-8478-ed44b52215b8 req-12580982-155f-483e-801c-7d2c0a214674 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:02.154118 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2b29ed8b-e6cd-4649-8478-ed44b52215b8 req-12580982-155f-483e-801c-7d2c0a214674 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:02.154551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2b29ed8b-e6cd-4649-8478-ed44b52215b8 req-12580982-155f-483e-801c-7d2c0a214674 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:02.166512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-2b29ed8b-e6cd-4649-8478-ed44b52215b8 req-12580982-155f-483e-801c-7d2c0a214674 service nova] Creating event network-vif-plugged:4c629978-1996-4de4-8529-a241038026a0 for instance cb392ede-a875-4d9d-92e6-f2470fd58a68 on hv-cinder-85265 Aug 18 21:06:02.171604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-2b29ed8b-e6cd-4649-8478-ed44b52215b8 req-12580982-155f-483e-801c-7d2c0a214674 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035365 Aug 18 21:06:02.172443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 534/1074] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:06:03.055957 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:03.056619 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:03.064262 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:03.064761 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:03.065203 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:03.065926 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:03.066382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:03.066817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:03.226387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:03.234287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3259e6a8-d563-4758-ab2d-6c4c5ab50169 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.183068 Aug 18 21:06:03.234860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 541/1075] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:03 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:04.260172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:04.260902 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:04.267662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:04.268143 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:04.268573 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:04.269278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:04.269719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:04.270144 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:04.423386 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:04.432336 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-41c6cc51-30e6-4d93-9984-811eb128d583 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.176913 Aug 18 21:06:04.432921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 535/1076] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:04 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:05.453301 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:05.453912 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:05.461239 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:05.461729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:05.462168 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:05.462885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:05.463337 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:05.463794 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:05.606352 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:05.614339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dc3033e5-328c-4c38-ad99-162049c70b27 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.164858 Aug 18 21:06:05.614885 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 542/1077] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:05 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:06.634478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:06.635041 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:06.641636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:06.642155 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:06.642597 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:06.643304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:06.643791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:06.644218 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:06.775935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:06.783925 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a2cc3a68-75f2-4ee5-b30f-8a13e3280e83 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.153550 Aug 18 21:06:06.784504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 536/1078] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:06 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:07.805966 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:07.806743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:07.814081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:07.814603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:07.815059 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:07.815809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:07.816268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:07.816730 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:07.963247 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:07.973792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-41d1238f-729e-4163-8c73-7c0c6a815fd3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1361 microversion: 2.1 time: 0.169883 Aug 18 21:06:07.973792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 543/1079] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:07 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:08.993765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:08.995134 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:09.002012 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:09.002531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:09.003129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:09.004273 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:09.004401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:09.004764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:09.139058 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:09.147038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-01e86959-4e7f-4431-b1e4-4dc9299ad9a7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1547 microversion: 2.1 time: 0.158852 Aug 18 21:06:09.148154 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 537/1080] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:08 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:09.169833 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:09.170490 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:09.177489 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:09.177980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:09.178420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:09.179171 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:09.179702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:09.180233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:09.266875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a1c1678e-ac47-4ff1-b695-9c9de42753d5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101171 Aug 18 21:06:09.267510 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 544/1081] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 21:06:09 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:06:10.616038 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-5692e435-aa69-4f64-848c-27e8aa7511f5 req-727aa9d9-2d66-40db-a657-61cb6db5fd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb392ede-a875-4d9d-92e6-f2470fd58a68", "tag": "4c629978-1996-4de4-8529-a241038026a0"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:06:10.626572 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5692e435-aa69-4f64-848c-27e8aa7511f5 req-727aa9d9-2d66-40db-a657-61cb6db5fd80 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:10.627065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5692e435-aa69-4f64-848c-27e8aa7511f5 req-727aa9d9-2d66-40db-a657-61cb6db5fd80 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:10.627532 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5692e435-aa69-4f64-848c-27e8aa7511f5 req-727aa9d9-2d66-40db-a657-61cb6db5fd80 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:10.640388 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-5692e435-aa69-4f64-848c-27e8aa7511f5 req-727aa9d9-2d66-40db-a657-61cb6db5fd80 service nova] Creating event network-changed:4c629978-1996-4de4-8529-a241038026a0 for instance cb392ede-a875-4d9d-92e6-f2470fd58a68 on hv-cinder-85265 Aug 18 21:06:10.646530 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-5692e435-aa69-4f64-848c-27e8aa7511f5 req-727aa9d9-2d66-40db-a657-61cb6db5fd80 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035744 Aug 18 21:06:10.647172 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 538/1082] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:06:30.877150 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:30.877922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=54 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:30.881901 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1804802752", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "networks": [{"uuid": "524a5d88-8ec7-4414-92b8-1ec017405b10"}]}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:06:30.938666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.network.neutron [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] validate_networks() for [('524a5d88-8ec7-4414-92b8-1ec017405b10', None, None, None, None, None)] {{(pid=127936) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:06:31.348106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Flavor limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:06:31.348609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Image limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:06:31.349145 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Flavor pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:06:31.349632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Image pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:06:31.350169 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:06:31.360611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:31.361091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:31.361521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:31.362238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:31.362692 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:31.363113 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:31.379645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Getting quotas for project ff08af38e1ad4f20abd69335871f313a. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:06:31.383884 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Getting quotas for user a1149c7b88df4f94942b1d11557c6511 and project ff08af38e1ad4f20abd69335871f313a. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:06:31.395189 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Going to run 1 instances... {{(pid=127936) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:06:31.397955 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127936) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:06:31.525868 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-14de4031-1274-4461-ab7d-32a5a680bab9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.650440 Aug 18 21:06:31.526528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 545/1083] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:06:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:06:31.535286 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:31.536608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=48 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:31.540871 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5654b892-413a-424a-bf07-28b571b379c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:31.541697 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5654b892-413a-424a-bf07-28b571b379c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:31.597760 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5654b892-413a-424a-bf07-28b571b379c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:31.604971 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5654b892-413a-424a-bf07-28b571b379c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1219 microversion: 2.1 time: 0.071311 Aug 18 21:06:31.605612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 539/1084] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:31 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:32.628147 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:32.628759 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:32.635712 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:32.636191 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:32.636628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:32.637346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:32.637792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:32.638210 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:32.705376 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:32.714642 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b4c50098-1778-47d6-bbbf-5e3c87acac48 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1223 microversion: 2.1 time: 0.092235 Aug 18 21:06:32.715279 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 546/1085] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:32 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:33.734908 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:33.735603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:33.743476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:33.743956 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:33.744384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:33.745067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:33.745512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:33.745929 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:33.807435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:33.815022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-641831e0-5abd-4a34-b58f-c4f3642ebe42 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1271 microversion: 2.1 time: 0.083978 Aug 18 21:06:33.815612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 540/1086] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:33 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:34.836652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:34.837265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:34.843465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:34.843961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:34.844983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:34.845133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:34.845551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:34.845982 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:35.016346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:35.024776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8744e231-6413-41e4-acfa-52718c4f6480 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.192487 Aug 18 21:06:35.025348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 547/1087] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:34 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:35.886260 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-17d0a9a7-4ab8-4502-b0bd-6367f1a02e65 req-7d5acbe1-0bce-4254-bad0-edc9125cce28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "817005e1-e90a-4151-bb97-5084ee4829c3", "tag": "9614d1da-b777-4217-ae03-f7fa0cedf518"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:06:35.898811 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-17d0a9a7-4ab8-4502-b0bd-6367f1a02e65 req-7d5acbe1-0bce-4254-bad0-edc9125cce28 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:35.899290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-17d0a9a7-4ab8-4502-b0bd-6367f1a02e65 req-7d5acbe1-0bce-4254-bad0-edc9125cce28 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:35.900034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-17d0a9a7-4ab8-4502-b0bd-6367f1a02e65 req-7d5acbe1-0bce-4254-bad0-edc9125cce28 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:35.917739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-17d0a9a7-4ab8-4502-b0bd-6367f1a02e65 req-7d5acbe1-0bce-4254-bad0-edc9125cce28 service nova] Creating event network-changed:9614d1da-b777-4217-ae03-f7fa0cedf518 for instance 817005e1-e90a-4151-bb97-5084ee4829c3 on hv-cinder-85265 Aug 18 21:06:35.923135 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-17d0a9a7-4ab8-4502-b0bd-6367f1a02e65 req-7d5acbe1-0bce-4254-bad0-edc9125cce28 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040756 Aug 18 21:06:35.927474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 541/1088] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:06:36.046089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:36.046848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:36.054158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:36.054728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:36.055242 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:36.056044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:36.056595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:36.057098 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:36.273343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:36.281446 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ce172b28-8093-414b-b3a1-3aa411509e44 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.239202 Aug 18 21:06:36.282474 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 548/1089] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:36 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:37.304585 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:37.305300 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:37.311952 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:37.312443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:37.312881 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:37.313596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:37.314060 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:37.314486 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:37.453578 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:37.461995 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0f66df54-07f4-4bff-bc24-54ae58d18bd9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.162651 Aug 18 21:06:37.462565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 542/1090] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:37 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:38.482180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:38.482823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:38.489587 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:38.490073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:38.491019 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:38.491756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:38.492214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:38.492636 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:38.636728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:38.644624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2ca12268-ee83-434e-a208-03dfffe2a396 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.166347 Aug 18 21:06:38.645202 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 549/1091] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:38 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:39.665839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:39.666391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:39.673008 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:39.673498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:39.673934 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:39.674636 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:39.675092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:39.675551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:39.812808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:39.821976 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cdd00ddf-56c7-4fe1-81f7-2223bee53d46 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.160323 Aug 18 21:06:39.822564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 543/1092] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:39 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:40.844365 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:40.845073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:40.851459 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:40.851949 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:40.852393 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:40.853089 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:40.853545 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:40.853975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:40.988420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:40.996896 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6f29882f-9145-4e64-b53e-5972c3d72122 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.156359 Aug 18 21:06:40.997469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 550/1093] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:40 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:42.018483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:42.019918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:42.022247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:42.029751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:42.035287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:42.035287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:42.035287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:42.035287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:42.035700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:42.134214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-8c1a0605-2cef-4d4b-9a8d-79973e1dd2c2 req-3a1932c1-3d17-43c8-98c6-b3fef2404798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817005e1-e90a-4151-bb97-5084ee4829c3", "name": "network-vif-plugged", "status": "completed", "tag": "9614d1da-b777-4217-ae03-f7fa0cedf518"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:06:42.141748 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:42.142469 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=6 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:42.147483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8c1a0605-2cef-4d4b-9a8d-79973e1dd2c2 req-3a1932c1-3d17-43c8-98c6-b3fef2404798 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:42.147985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8c1a0605-2cef-4d4b-9a8d-79973e1dd2c2 req-3a1932c1-3d17-43c8-98c6-b3fef2404798 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:42.148442 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-8c1a0605-2cef-4d4b-9a8d-79973e1dd2c2 req-3a1932c1-3d17-43c8-98c6-b3fef2404798 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:42.160940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-8c1a0605-2cef-4d4b-9a8d-79973e1dd2c2 req-3a1932c1-3d17-43c8-98c6-b3fef2404798 service nova] Creating event network-vif-plugged:9614d1da-b777-4217-ae03-f7fa0cedf518 for instance 817005e1-e90a-4151-bb97-5084ee4829c3 on hv-cinder-85265 Aug 18 21:06:42.167479 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-8c1a0605-2cef-4d4b-9a8d-79973e1dd2c2 req-3a1932c1-3d17-43c8-98c6-b3fef2404798 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037078 Aug 18 21:06:42.172353 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 551/1094] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:06:42.181086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:42.189143 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fd1c9ab2-dab8-492b-a154-7d89e84c1512 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.175073 Aug 18 21:06:42.189713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 544/1095] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:42 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:06:43.211461 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:43.212158 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:43.218954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:43.219441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:43.219882 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:43.220579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:43.221035 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:43.221459 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:43.358447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:43.366172 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7aa4c555-e0e1-46b3-be4f-812c808729d1 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1319 microversion: 2.1 time: 0.160367 Aug 18 21:06:43.366743 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 552/1096] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:43 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:06:44.386867 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:06:44.387513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:06:44.394579 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:44.395073 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:44.395551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:44.396270 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:06:44.396735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:06:44.397763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:06:44.534930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:06:44.543707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7987a11e-2d54-4c5a-a934-a0f7ea4dfb78 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1509 microversion: 2.1 time: 0.161337 Aug 18 21:06:44.544287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 545/1097] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:06:44 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:07.471112 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "668bb593-b39f-4cc0-bcc9-65ad743c1d03", "device": "/dev/sdb"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:07:07.474026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:07.476633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:07.482071 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=40 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:07.482478 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:07.482969 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:07.483428 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:07.484129 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:07.484574 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:07.484994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:08.319223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f5470ed5-9da5-4cd6-8cc7-b7338f748976 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "POST /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851463 Aug 18 21:07:08.319871 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 553/1098] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:07:07 2022] POST /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:07:36.339957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:36.340567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:36.346872 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=16 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:36.346872 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=32 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:36.348128 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:36.348612 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:36.349045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:36.350015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:36.350192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:36.350610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:36.435456 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lazy-loading 'services' on Instance uuid 817005e1-e90a-4151-bb97-5084ee4829c3 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:07:36.698596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ece47315-2ecd-47ab-a21f-8ef2dbb1a820 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "DELETE /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3/os-volume_attachments/668bb593-b39f-4cc0-bcc9-65ad743c1d03" status: 202 len: 0 microversion: 2.1 time: 0.362692 Aug 18 21:07:36.699199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 546/1099] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:07:36 2022] DELETE /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3/os-volume_attachments/668bb593-b39f-4cc0-bcc9-65ad743c1d03 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:07:37.821119 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:37.822514 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:37.826538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:37.827146 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:37.833320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:37.833805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:37.834240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:37.834939 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:37.835421 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:37.835848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:37.861136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:07:38.190481 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f5ccce24-778b-41c9-a095-166155fa8700 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "DELETE /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 204 len: 0 microversion: 2.1 time: 0.370572 Aug 18 21:07:38.191073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 554/1100] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:07:37 2022] DELETE /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:07:38.200498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:38.201239 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:38.207794 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:38.208278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:38.208708 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:38.209461 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:38.209854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:38.210270 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:38.343066 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:38.352960 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-876d32ab-bf5d-4062-92a3-2bb2c54de5e0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1515 microversion: 2.1 time: 0.157308 Aug 18 21:07:38.353608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 547/1101] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:38 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:39.374847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:39.375566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:39.383003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:39.383528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:39.383971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:39.384675 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:39.385125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:39.385553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:39.518575 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:39.527204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8bb3fb4c-1a30-4306-aeaf-ccdd6845f80c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1515 microversion: 2.1 time: 0.156883 Aug 18 21:07:39.527833 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 555/1102] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:39 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:40.548944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:40.550197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:40.556930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:40.557413 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:40.557848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:40.558578 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:40.559026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:40.559469 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:40.697087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:40.705176 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-41ff78ac-c14d-4900-910e-7434e356662c tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1515 microversion: 2.1 time: 0.160048 Aug 18 21:07:40.705841 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 548/1103] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:40 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:40.946236 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-5bd5644d-9ced-4dc4-a0fb-3ae676428da8 req-86a887a6-6a5b-4e85-9b36-3bd8a5e46ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "817005e1-e90a-4151-bb97-5084ee4829c3", "name": "network-vif-deleted", "tag": "9614d1da-b777-4217-ae03-f7fa0cedf518"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:07:40.956233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-5bd5644d-9ced-4dc4-a0fb-3ae676428da8 req-86a887a6-6a5b-4e85-9b36-3bd8a5e46ac8 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:40.956720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-5bd5644d-9ced-4dc4-a0fb-3ae676428da8 req-86a887a6-6a5b-4e85-9b36-3bd8a5e46ac8 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:40.957156 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-5bd5644d-9ced-4dc4-a0fb-3ae676428da8 req-86a887a6-6a5b-4e85-9b36-3bd8a5e46ac8 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:40.968994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-5bd5644d-9ced-4dc4-a0fb-3ae676428da8 req-86a887a6-6a5b-4e85-9b36-3bd8a5e46ac8 service nova] Creating event network-vif-deleted:9614d1da-b777-4217-ae03-f7fa0cedf518 for instance 817005e1-e90a-4151-bb97-5084ee4829c3 on hv-cinder-85265 Aug 18 21:07:40.974057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-5bd5644d-9ced-4dc4-a0fb-3ae676428da8 req-86a887a6-6a5b-4e85-9b36-3bd8a5e46ac8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032187 Aug 18 21:07:40.974642 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 556/1104] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:07:41.729780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:41.730544 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:41.738330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:41.738822 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:41.739262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:41.740587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:41.741056 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:41.741528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:41.774072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:41.774561 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:41.775024 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:41.775485 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lazy-loading 'fault' on Instance uuid 817005e1-e90a-4151-bb97-5084ee4829c3 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:07:41.824067 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:41.833363 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-cc07e5de-84e1-4c98-a00c-28d5be8692d0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 200 len: 1309 microversion: 2.1 time: 0.107856 Aug 18 21:07:41.833978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 549/1105] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:41 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:42.862065 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:42.862762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: 817005e1-e90a-4151-bb97-5084ee4829c3] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:42.869422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:42.869905 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:42.870345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:42.871040 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:42.871531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:42.871961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:42.885805 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] HTTP exception thrown: Instance 817005e1-e90a-4151-bb97-5084ee4829c3 could not be found. Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Request method failure captured: Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 HTTP/1.1 Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qnUQrtQX16Txeu8TLkemOo3JSwyw9xEzjI32TYiE_XMFqoSj6_z5zO4_HpWuY0trcUX9nVKxErHES_73Jg6cWYO1H9v3QBHVwQL-LXtcs2V9uUbm9u0EwV542IRQPsvfJ3JekUiTDRGdKeTYhCmavxWcH7V-FOtP4bToJdsgYW6c1U Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: ff08af38e1ad4f20abd69335871f313a Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1437892956 Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:07:42.887476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesSnapshotTestJSON-1437892956 Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: ff08af38e1ad4f20abd69335871f313a Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1437892956 Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesSnapshotTestJSON-1437892956-project Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: a1149c7b88df4f94942b1d11557c6511 Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesSnapshotTestJSON-1437892956-project Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 817005e1-e90a-4151-bb97-5084ee4829c3 could not be found. Aug 18 21:07:42.888954 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '817005e1-e90a-4151-bb97-5084ee4829c3'} Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 817005e1-e90a-4151-bb97-5084ee4829c3 could not be found. Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:07:42.889945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 817005e1-e90a-4151-bb97-5084ee4829c3 could not be found. Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 817005e1-e90a-4151-bb97-5084ee4829c3 could not be found. Aug 18 21:07:42.891595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:07:42.893548 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Returning 404 to user: Instance 817005e1-e90a-4151-bb97-5084ee4829c3 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:07:42.893548 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5c15dbe4-aa70-4bae-a5cf-5d81a6f4b739 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3" status: 404 len: 111 microversion: 2.1 time: 0.031479 Aug 18 21:07:42.893548 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 557/1106] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:42 2022] GET /compute/v2.1/servers/817005e1-e90a-4151-bb97-5084ee4829c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:07:49.772987 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:49.773515 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:49.780207 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:49.780700 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:49.781137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:49.781852 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:49.782292 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:49.782721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:49.807878 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1d7f32da-22ac-42d3-965f-fae3d53a41a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/ips" status: 200 len: 145 microversion: 2.1 time: 0.039268 Aug 18 21:07:49.808460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 550/1107] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 21:07:49 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:07:50.716510 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:50.717096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:50.723081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:50.724122 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:50.724566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:50.725261 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:50.725717 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:50.726151 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:50.752135 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:07:51.109947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-95650bb9-4d40-46fe-a317-74606c30fde0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 204 len: 0 microversion: 2.1 time: 0.397105 Aug 18 21:07:51.110543 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 558/1108] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:07:50 2022] DELETE /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:07:51.119000 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:51.119649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:51.126168 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:51.129152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:51.129152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:51.129152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:51.129152 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:51.129782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:51.267969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:51.276474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7ec1be83-77df-442e-8664-fe45e0d70cd9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1577 microversion: 2.1 time: 0.161348 Aug 18 21:07:51.277047 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 551/1109] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:51 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:52.298959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:52.299684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:52.306166 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:52.306651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:52.307082 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:52.307808 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:52.308255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:52.308672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:52.449824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:52.457853 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-af636a73-f938-4b27-a19d-e42461df76b3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1577 microversion: 2.1 time: 0.163017 Aug 18 21:07:52.459072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 559/1110] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:52 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:53.481629 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:53.482163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:53.488754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:53.489744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:53.490203 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:53.490878 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:53.491337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:53.491779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:53.628227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:53.636707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ae14483c-fdaf-44f4-85bb-e9133a35e61d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1577 microversion: 2.1 time: 0.159044 Aug 18 21:07:53.637278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 552/1111] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:53 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:54.658091 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:54.658690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:54.666145 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:54.666640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:54.667149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:54.667881 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:54.668338 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:54.668764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:54.805426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:54.815412 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e550ddce-7edd-4e04-8042-5ecd65927eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1577 microversion: 2.1 time: 0.161100 Aug 18 21:07:54.816001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 560/1112] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:54 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:55.334434 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-954329624", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "networks": [{"uuid": "524a5d88-8ec7-4414-92b8-1ec017405b10"}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:07:55.391542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] validate_networks() for [('524a5d88-8ec7-4414-92b8-1ec017405b10', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:07:55.762807 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:07:55.763240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:07:55.763936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:07:55.764358 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:07:55.764779 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:07:55.774660 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:55.775064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:55.775530 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:55.776268 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:55.776724 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:55.777151 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:55.795569 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Getting quotas for project ff08af38e1ad4f20abd69335871f313a. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:07:55.800671 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Getting quotas for user a1149c7b88df4f94942b1d11557c6511 and project ff08af38e1ad4f20abd69335871f313a. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:07:55.815941 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:07:55.818288 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:07:55.837052 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:55.837799 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:55.844294 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:55.844908 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:55.845344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:55.846050 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:55.846766 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:55.847195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:55.924233 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:55.933445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-78427ce8-e2d7-45d3-bccc-18f91e3dee03 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1510 microversion: 2.1 time: 0.100854 Aug 18 21:07:55.934815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 561/1113] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:55 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:07:55.973318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7543b8bf-b23c-45d9-af89-ed10f8ca8a95 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642795 Aug 18 21:07:55.974918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 553/1114] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:07:55.985325 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-3b08f83d-c02c-48e3-ae2e-e892b2c9b61b tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:55.985945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-3b08f83d-c02c-48e3-ae2e-e892b2c9b61b tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:56.084480 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "418e1c42-ee1c-4a9a-a7da-8c1c36f4f434"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:07:56.087138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:56.091829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-3b08f83d-c02c-48e3-ae2e-e892b2c9b61b tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:56.096471 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:56.096962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:56.097598 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:56.098248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:56.099240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:56.099889 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:56.101095 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-3b08f83d-c02c-48e3-ae2e-e892b2c9b61b tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1218 microversion: 2.1 time: 0.119723 Aug 18 21:07:56.101782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 562/1115] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:55 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:56.182655 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-4d7f9624-03a8-4421-b345-26986613e56f req-8525226c-9024-45d8-8439-228bf4828080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e799d4da-faeb-4a1e-9014-d742d8218de1", "name": "network-vif-deleted", "tag": "84e33ea0-ae3b-4e20-a443-e04b7511d9b3"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:07:56.221079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-4d7f9624-03a8-4421-b345-26986613e56f req-8525226c-9024-45d8-8439-228bf4828080 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:56.221570 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-4d7f9624-03a8-4421-b345-26986613e56f req-8525226c-9024-45d8-8439-228bf4828080 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:56.222005 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-4d7f9624-03a8-4421-b345-26986613e56f req-8525226c-9024-45d8-8439-228bf4828080 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:56.242678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-4d7f9624-03a8-4421-b345-26986613e56f req-8525226c-9024-45d8-8439-228bf4828080 service nova] Creating event network-vif-deleted:84e33ea0-ae3b-4e20-a443-e04b7511d9b3 for instance e799d4da-faeb-4a1e-9014-d742d8218de1 on hv-cinder-85265 Aug 18 21:07:56.251306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-4d7f9624-03a8-4421-b345-26986613e56f req-8525226c-9024-45d8-8439-228bf4828080 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071458 Aug 18 21:07:56.252230 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 563/1116] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:07:56.954977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:56.955698 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:56.962533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:56.963029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:56.963499 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:56.964208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:56.964666 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:56.965094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:56.999063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:56.999580 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:57.000056 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:57.000457 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lazy-loading 'fault' on Instance uuid e799d4da-faeb-4a1e-9014-d742d8218de1 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:07:57.045963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:57.055026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-1c517dae-b36e-4c8d-91f3-53b5e8b2ce10 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 200 len: 1230 microversion: 2.1 time: 0.104097 Aug 18 21:07:57.058422 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 564/1117] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:56 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:07:57.122057 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:57.122742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:57.131083 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a2027e10-db8d-42b6-8d2f-ce4e7c10bb07 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.050821 Aug 18 21:07:57.132409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 554/1118] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:07:56 2022] POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-volume_attachments => generated 194 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:07:57.138504 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:57.139776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:57.140455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:57.141983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:57.142656 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:57.143287 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:57.221133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:57.229791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-94adb95a-1408-400e-9a40-cb46260a7ab2 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1222 microversion: 2.1 time: 0.112212 Aug 18 21:07:57.230386 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 565/1119] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:57 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:07:58.077091 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:58.077826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:58.084963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:58.085447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:58.085877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:58.086581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:58.087045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:58.087498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:58.108351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] HTTP exception thrown: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Request method failure captured: Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 HTTP/1.1 Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qlJWNeP6nHlKIv4wEHSTZgbUGvvNKYQF1qr0U2qWkAmkwaXNcBzqZht--WFwmC-o5AEvm8YqJWTxk6g51FeIaMz-0ZchsGF-zuryqsD_eR1XP3KDEWh-KzXoK7t76tzMFKegSKb4bO7nSHIZi9Gte9tmRRvhd5VqmQS8TyTd1V7L_U Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:07:58.110651 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: e9c8beca893f40f08befa76dd712285f Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:07:58.112365 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': 'e799d4da-faeb-4a1e-9014-d742d8218de1'} Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:07:58.113382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:07:58.115642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:07:58.117045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Returning 404 to user: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:07:58.117045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7c54ffd5-4e0f-4abd-ba64-4fa0a7486fb0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 404 len: 111 microversion: 2.1 time: 0.039784 Aug 18 21:07:58.117045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 555/1120] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:58 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:07:58.214234 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-186016712", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2088657920", "security_groups": [{"name": "tempest-secgroup-smoke-914677998"}], "block_device_mapping_v2": [{"uuid": "b45f78ad-d097-40b7-a917-4879c831e101", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4a561f3f-ff1c-4783-b0f8-48e566defdc4"}]}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:07:58.251312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:58.251985 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:58.259458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:58.260320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:58.261052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:58.261955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:58.262582 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:58.263257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:58.342932 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:58.352913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f48257d9-66b5-471b-b07e-f3a93e9b18c0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1278 microversion: 2.1 time: 0.105953 Aug 18 21:07:58.354099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 556/1121] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:58 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:07:58.471838 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.network.neutron [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] validate_networks() for [('4a561f3f-ff1c-4783-b0f8-48e566defdc4', None, None, None, None, None)] {{(pid=127936) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:07:59.052248 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Flavor limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:07:59.052729 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Image limits 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:07:59.053265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Flavor pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:07:59.054034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Image pref 0:0:0 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:07:59.054310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.virt.hardware [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127936) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:07:59.062994 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:59.063501 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:59.063933 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:59.064649 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:59.065273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:59.065556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:59.083700 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:07:59.087735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for user e9c8beca893f40f08befa76dd712285f and project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'cores', 'instances', 'ram'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:07:59.147738 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Going to run 1 instances... {{(pid=127936) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:07:59.150004 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b45f78ad-d097-40b7-a917-4879c831e101',volume_size=None,volume_type=None)] {{(pid=127936) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:07:59.374371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:59.374986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:59.385805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:59.386299 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:59.386736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:59.387466 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:07:59.387918 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:07:59.388342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:07:59.533966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:59.542629 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-20207535-eb4d-4cfe-a3c2-b781db848b13 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.172628 Aug 18 21:07:59.543217 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 557/1122] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:59 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:07:59.574987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d8734e5e-dd2a-4b06-ab98-38eb128edbd8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.364701 Aug 18 21:07:59.576127 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 566/1123] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:07:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:07:59.589374 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ca3c6a2a-f11f-4fa2-b523-ec31ef6efc69 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:07:59.594581 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ca3c6a2a-f11f-4fa2-b523-ec31ef6efc69 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:07:59.668226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ca3c6a2a-f11f-4fa2-b523-ec31ef6efc69 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:07:59.673309 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ca3c6a2a-f11f-4fa2-b523-ec31ef6efc69 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1094 microversion: 2.1 time: 0.089967 Aug 18 21:07:59.675397 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 558/1124] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:07:59 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:00.326963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-e01ae92c-6987-4084-962a-c3d33ce71fa2 req-4417588c-9c6d-47d1-9f01-26ab56c6c236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae", "tag": "9357ef33-7276-4f3d-81e2-1196b85bb636"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:00.337307 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e01ae92c-6987-4084-962a-c3d33ce71fa2 req-4417588c-9c6d-47d1-9f01-26ab56c6c236 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:00.337787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e01ae92c-6987-4084-962a-c3d33ce71fa2 req-4417588c-9c6d-47d1-9f01-26ab56c6c236 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:00.338248 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e01ae92c-6987-4084-962a-c3d33ce71fa2 req-4417588c-9c6d-47d1-9f01-26ab56c6c236 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:00.349523 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-e01ae92c-6987-4084-962a-c3d33ce71fa2 req-4417588c-9c6d-47d1-9f01-26ab56c6c236 service nova] Creating event network-changed:9357ef33-7276-4f3d-81e2-1196b85bb636 for instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae on hv-cinder-85265 Aug 18 21:08:00.356667 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-e01ae92c-6987-4084-962a-c3d33ce71fa2 req-4417588c-9c6d-47d1-9f01-26ab56c6c236 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033595 Aug 18 21:08:00.357880 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 567/1125] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:08:00.563182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:00.564157 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:00.573949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:00.581980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:00.581980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:00.581980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:00.581980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:00.582592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:00.694585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:00.695273 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:00.701879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:00.702597 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:00.703232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:00.704135 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:00.704583 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:00.705215 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:00.716277 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:00.725285 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6a498eda-f164-45a7-bb2f-294c62592d71 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.165958 Aug 18 21:08:00.726169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 559/1126] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:00 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:00.837898 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:00.846371 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-9f3c4409-8173-450f-a2ec-b7f730279cdf tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1144 microversion: 2.1 time: 0.155843 Aug 18 21:08:00.846921 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 568/1127] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:00 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1144 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:01.746284 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:01.746861 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:01.753289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:01.753774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:01.754208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:01.754903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:01.755355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:01.755803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:01.867662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:01.868277 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:01.875719 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:01.876455 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:01.877491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:01.877846 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:01.878398 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:01.878817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:01.890220 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:01.898628 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fbab5f79-2c66-4be3-9574-ea6ca9c76124 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.156798 Aug 18 21:08:01.899568 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 560/1128] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:01 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:01.946760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:01.954560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-08fb9fc8-38ae-479b-8206-95179fff7aa2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1192 microversion: 2.1 time: 0.090764 Aug 18 21:08:01.955153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 569/1129] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:01 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:02.920637 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:02.921243 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:02.934713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:02.935333 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:02.935966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:02.937160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:02.937733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:02.938171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:02.976330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:02.976922 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:02.983573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:02.989456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:02.989456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:02.989456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:02.989456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:02.989897 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:03.052329 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:03.057965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2d43e279-1a6c-44ba-8524-b351b2200ab0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1192 microversion: 2.1 time: 0.085194 Aug 18 21:08:03.058434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 570/1130] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:02 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:03.073694 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:03.081772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1e364188-802b-42cc-ae49-5f9d4f485f03 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.165024 Aug 18 21:08:03.082325 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 561/1131] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:02 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:04.079536 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:04.080148 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:04.087447 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:04.087947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:04.088383 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:04.089127 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:04.089585 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:04.090016 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:04.094581 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:04.102720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:04.103493 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:04.111803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:04.118604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:04.118604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:04.118604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:04.118604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:04.118993 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:04.158813 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:04.163162 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e6aeb60a-6c2f-489c-b663-c67c9392a371 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1200 microversion: 2.1 time: 0.086752 Aug 18 21:08:04.163804 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 571/1132] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:04 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1200 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:04.252180 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:04.256479 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:04.260978 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a6ab3e4d-b481-4ee8-b6c1-67889b0c33a9 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.162852 Aug 18 21:08:04.261544 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 562/1133] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:04 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:05.185195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:05.185892 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:05.193616 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:05.194106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:05.194539 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:05.195427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:05.195880 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:05.196303 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:05.282146 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:05.283011 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:05.290751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:05.291318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:05.291908 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:05.292714 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:05.293377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:05.293803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:05.418592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:05.429929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-829a6e54-c3dd-4f6b-8d38-74e382422bf7 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1277 microversion: 2.1 time: 0.249143 Aug 18 21:08:05.430792 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 572/1134] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:05 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:05.465623 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:05.474216 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7bb880f8-eedc-4e57-9bf7-430dc0139718 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.195929 Aug 18 21:08:05.474797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 563/1135] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:05 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:05.784742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8362a41c-19bd-48e0-af09-49006b5df44a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:05.792318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8362a41c-19bd-48e0-af09-49006b5df44a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:05.792832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8362a41c-19bd-48e0-af09-49006b5df44a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:05.793259 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8362a41c-19bd-48e0-af09-49006b5df44a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:05.861330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8362a41c-19bd-48e0-af09-49006b5df44a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Going to try to stop instance {{(pid=127936) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 21:08:06.056935 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8362a41c-19bd-48e0-af09-49006b5df44a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action" status: 202 len: 0 microversion: 2.1 time: 0.276087 Aug 18 21:08:06.060014 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 573/1136] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 21:08:05 2022] POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:08:06.066552 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:06.068608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:06.074992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:06.083836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:06.083836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:06.083836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:06.083836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:06.084278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:06.084278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:06.091594 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-c61ba088-8a42-4f72-863f-3c33a33518db req-bd3e789f-58a9-47b2-87a9-6b8978a920b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4b9e9b-fced-4a35-8bf4-3c5c600266c7", "tag": "93ff712a-f831-4d10-abd7-d6db6e16b902"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:06.102563 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-c61ba088-8a42-4f72-863f-3c33a33518db req-bd3e789f-58a9-47b2-87a9-6b8978a920b9 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:06.103036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-c61ba088-8a42-4f72-863f-3c33a33518db req-bd3e789f-58a9-47b2-87a9-6b8978a920b9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:06.103500 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-c61ba088-8a42-4f72-863f-3c33a33518db req-bd3e789f-58a9-47b2-87a9-6b8978a920b9 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:06.117556 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-c61ba088-8a42-4f72-863f-3c33a33518db req-bd3e789f-58a9-47b2-87a9-6b8978a920b9 service nova] Creating event network-changed:93ff712a-f831-4d10-abd7-d6db6e16b902 for instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 on hv-cinder-85265 Aug 18 21:08:06.126929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-c61ba088-8a42-4f72-863f-3c33a33518db req-bd3e789f-58a9-47b2-87a9-6b8978a920b9 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036726 Aug 18 21:08:06.126929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 574/1137] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:08:06.230796 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:06.239947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c6bad30d-80e8-4622-9991-559ccf1eeee5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.177790 Aug 18 21:08:06.240549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 564/1138] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:06 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:06.454416 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:06.455670 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:06.464643 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:06.465671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:06.466123 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:06.466877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:06.467327 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:06.468039 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:06.497419 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:06.498095 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:06.504565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:06.508731 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:06.509243 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:06.509663 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:06.510376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:06.510831 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:06.511258 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:06.663136 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:06.672467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9d2f78e4-e042-4b83-84cc-97fde2c2bb59 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.179204 Aug 18 21:08:06.673064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 565/1139] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:06 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:06.719515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:06.728140 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b8e4a984-756e-4c9b-b424-8bde84fad590 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.278807 Aug 18 21:08:06.728718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 575/1140] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:06 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:07.261828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:07.266453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:07.268467 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:07.268953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:07.269383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:07.270719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:07.271165 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:07.271610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:07.406958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:07.415621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-10bed10d-bd79-47f2-94e8-5b00c5b2aa3e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.157648 Aug 18 21:08:07.416181 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 566/1141] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:07 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:07.693847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:07.694397 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:07.700879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:07.701358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:07.701793 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:07.702493 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:07.702933 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:07.703382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:07.749824 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:07.750596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:07.757914 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:07.758401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:07.758838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:07.759576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:07.760030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:07.760457 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:07.896998 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:07.905006 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ac5c4805-b96d-49f5-87ae-28487928571c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.158961 Aug 18 21:08:07.905583 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 567/1142] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:07 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:07.955470 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:07.959510 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c3e92760-b5c9-4a6d-aff0-85bfb41b241d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.270169 Aug 18 21:08:07.960079 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 576/1143] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:07 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:08.436401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:08.437032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:08.443506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:08.443982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:08.444422 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:08.445138 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:08.445595 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:08.446020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:08.538984 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-6a101407-6334-46cc-b0a1-8c86279c9fd6 req-c540ac21-cff9-4a08-9339-b78e982a6adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae", "name": "network-vif-plugged", "status": "completed", "tag": "9357ef33-7276-4f3d-81e2-1196b85bb636"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:08.545889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:08.549735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-6a101407-6334-46cc-b0a1-8c86279c9fd6 req-c540ac21-cff9-4a08-9339-b78e982a6adf service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:08.550266 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-6a101407-6334-46cc-b0a1-8c86279c9fd6 req-c540ac21-cff9-4a08-9339-b78e982a6adf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:08.550941 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-6a101407-6334-46cc-b0a1-8c86279c9fd6 req-c540ac21-cff9-4a08-9339-b78e982a6adf service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:08.563291 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-6a101407-6334-46cc-b0a1-8c86279c9fd6 req-c540ac21-cff9-4a08-9339-b78e982a6adf service nova] Creating event network-vif-plugged:9357ef33-7276-4f3d-81e2-1196b85bb636 for instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae on hv-cinder-85265 Aug 18 21:08:08.568208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-6a101407-6334-46cc-b0a1-8c86279c9fd6 req-c540ac21-cff9-4a08-9339-b78e982a6adf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034162 Aug 18 21:08:08.569342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 577/1144] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:08:08.581139 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:08.590799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ba3497bd-bd37-4809-aff3-40d34ce8b99b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.158266 Aug 18 21:08:08.591383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 568/1145] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:08 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:08.926001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:08.927197 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:08.939462 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:08.940014 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:08.940463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:08.941177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:08.941631 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:08.942067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:08.980730 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:08.981373 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:08.987865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:08.988351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:08.988789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:08.990149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:08.990705 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:08.991101 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:09.074216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:09.094840 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=8 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:09.101241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:09.109117 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b798474b-c1c0-4f00-b5ba-5441410d054c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.187437 Aug 18 21:08:09.109699 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 578/1146] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:08 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:09.131392 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:09.139016 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ef6e71b9-5a34-44bd-abc0-15c43016cb30 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.162295 Aug 18 21:08:09.139639 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 569/1147] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:08 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:09.612380 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:09.612894 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:09.619770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:09.620390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:09.620816 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:09.621498 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:09.621945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:09.622370 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:09.762009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:09.770456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8eeb2a46-b297-47a9-ab55-8393a348d5b3 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.161940 Aug 18 21:08:09.771595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 579/1148] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:09 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:10.130800 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:10.131458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:10.133388 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=8 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:10.138726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:10.139201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:10.139656 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:10.140343 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:10.140784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:10.141201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:10.159747 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:10.160405 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:10.167693 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:10.168182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:10.168618 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:10.169318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:10.169773 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:10.170200 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:10.279827 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:10.289008 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-244a7121-a402-4b1d-827b-84082cc5d53b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.162667 Aug 18 21:08:10.289634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 570/1149] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:10 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:10.313005 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:10.329330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-284e44ed-15cf-447d-87e7-2e8563b9459d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1318 microversion: 2.1 time: 0.172893 Aug 18 21:08:10.330368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 580/1150] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:10 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:10.792133 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:10.792754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:10.798869 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:10.799356 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:10.799820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:10.800521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:10.800973 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:10.801975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:10.935063 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:10.944084 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-be6dca51-c247-455f-b96a-4eeb9285aa80 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.155809 Aug 18 21:08:10.947950 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 571/1151] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:10 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:11.310345 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:11.310971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:11.317446 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.317926 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.318358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:11.319049 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.319526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.319946 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:11.353020 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:11.361399 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:11.362770 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.363022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.363382 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:11.364112 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.364566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.364994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:11.459865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:11.468762 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-54c010b2-e7e8-400d-854d-dbb76ee4c79f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.162236 Aug 18 21:08:11.469341 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 581/1152] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:11 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:11.500877 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:11.508818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-97ed703e-2dfa-4dac-97ca-8e6bf01731a3 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1507 microversion: 2.1 time: 0.160087 Aug 18 21:08:11.509391 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 572/1153] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:11 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:11.529149 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c15d0cb-c8bf-4205-8a94-b0c7bb96c16b", "device": "/dev/sdb"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:11.531668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:11.538693 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.539175 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.539659 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:11.540354 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.540798 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.541218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:11.965630 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:11.966237 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:11.973210 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.973782 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.974232 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:11.974942 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:11.975417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:11.975854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:12.108290 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:12.119538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ce40c1bb-75c8-4293-852e-4143f6934061 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.157765 Aug 18 21:08:12.120119 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 573/1154] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:11 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:12.410286 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b8f01cae-7eba-40d9-aa07-59c3cf1ae596 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "POST /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884854 Aug 18 21:08:12.410908 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 582/1155] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:08:11 2022] POST /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae/os-volume_attachments => generated 194 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:08:12.491211 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:12.491928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:12.498669 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:12.499170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:12.499652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:12.500384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:12.500839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:12.501262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:12.655226 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:12.664887 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d2574aef-83c9-4690-ba90-c06d4ea6201e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.178590 Aug 18 21:08:12.665473 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 574/1156] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:12 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:13.141965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:13.142736 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:13.149830 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:13.150318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:13.150755 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:13.151503 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:13.151960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:13.152390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:13.294083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:13.302464 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-22c07003-1b27-4f13-95f2-fc38931b71fc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.165298 Aug 18 21:08:13.303020 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 583/1157] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:13 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:13.687180 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:13.687866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:13.695986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:13.696533 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:13.696982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:13.697695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:13.698142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:13.698577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:13.831141 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:13.839698 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8e52e004-c1ed-4612-91b8-2250f55fd165 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.156447 Aug 18 21:08:13.840264 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 575/1158] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:13 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:14.323704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:14.324309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:14.330739 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:14.331223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:14.331690 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:14.332406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:14.332857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:14.333788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:14.470222 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:14.479406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0b760996-26e9-4f12-be68-2f3e32731d7d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.159570 Aug 18 21:08:14.479980 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 584/1159] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:14 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:14.861206 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:14.861762 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:14.868283 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:14.868822 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:14.869249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:14.869945 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:14.870399 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:14.870821 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:15.004050 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:15.012279 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-5668cf91-0952-4532-b9af-3d777d232d7b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.155053 Aug 18 21:08:15.012846 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 576/1160] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:14 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:15.500325 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:15.500965 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:15.507464 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:15.507947 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:15.508393 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:15.509084 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:15.509538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:15.509969 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:15.647605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:15.656911 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ccfe2750-1187-4d1d-bdb5-8a8979cb917a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.160371 Aug 18 21:08:15.657486 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 585/1161] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:15 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:16.033478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:16.034097 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:16.041477 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:16.041959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:16.042394 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:16.043091 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:16.043572 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:16.044001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:16.233712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:16.241373 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1255f067-c9a2-4938-8afe-142130cb32b4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.211890 Aug 18 21:08:16.241941 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 577/1162] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:16 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:16.678881 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:16.679542 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:16.686054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:16.686537 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:16.686968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:16.687733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:16.688188 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:16.688609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:16.819390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:16.822959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:16.827981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-808b5d08-2f9b-4f38-9559-080524c04c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.153940 Aug 18 21:08:16.828552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 586/1163] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:16 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:17.261898 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:17.262495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:17.268921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:17.269395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:17.269820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:17.271168 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:17.271642 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:17.272065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:17.410361 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:17.418417 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-837cae86-4533-40bb-84a0-8b79e02cb9c8 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.160372 Aug 18 21:08:17.418987 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 578/1164] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:17 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:17.850465 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:17.851076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:17.857786 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:17.858268 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:17.858704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:17.859425 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:17.859875 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:17.869221 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:17.996900 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:18.005735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-a29841e3-88d5-46ec-a49f-9543a59e897d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.159524 Aug 18 21:08:18.006298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 587/1165] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:17 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:18.439591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:18.440201 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:18.447506 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:18.447985 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:18.448419 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:18.449111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:18.449564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:18.449986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:18.501072 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=100 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:18.581632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-cabd0bd7-01be-41a6-838a-aef242d467de req-0f24b766-0c94-41f8-9363-ec41ec5d3df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4b9e9b-fced-4a35-8bf4-3c5c600266c7", "name": "network-vif-plugged", "status": "completed", "tag": "93ff712a-f831-4d10-abd7-d6db6e16b902"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:18.591204 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:18.592866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cabd0bd7-01be-41a6-838a-aef242d467de req-0f24b766-0c94-41f8-9363-ec41ec5d3df5 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:18.593364 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cabd0bd7-01be-41a6-838a-aef242d467de req-0f24b766-0c94-41f8-9363-ec41ec5d3df5 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:18.593934 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-cabd0bd7-01be-41a6-838a-aef242d467de req-0f24b766-0c94-41f8-9363-ec41ec5d3df5 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:18.599939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-47050b51-fe99-49cf-85f1-9e84f7d7a72b tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.164181 Aug 18 21:08:18.600452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 579/1166] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:18 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:18.606045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-cabd0bd7-01be-41a6-838a-aef242d467de req-0f24b766-0c94-41f8-9363-ec41ec5d3df5 service nova] Creating event network-vif-plugged:93ff712a-f831-4d10-abd7-d6db6e16b902 for instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 on hv-cinder-85265 Aug 18 21:08:18.611270 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-cabd0bd7-01be-41a6-838a-aef242d467de req-0f24b766-0c94-41f8-9363-ec41ec5d3df5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033380 Aug 18 21:08:18.612412 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 588/1167] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:08:19.027806 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:19.028726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:19.034632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:19.035130 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:19.035623 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:19.036913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:19.037373 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:19.038061 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:19.169944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:19.178602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-219db16a-ec71-4ded-b91d-c01dc4e88614 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.154619 Aug 18 21:08:19.179178 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 580/1168] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:19 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:19.621981 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:19.622593 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:19.630612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:19.631104 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:19.631776 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:19.633116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:19.633116 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:19.633488 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:19.765305 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:19.773823 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5cb3dc48-4a27-4017-8029-aa83bc7a67d3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.156045 Aug 18 21:08:19.774392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 589/1169] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:19 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:20.199746 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:20.200347 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:20.206836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:20.207319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:20.207820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:20.209043 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:20.209499 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:20.209928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:20.340514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:20.353105 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d14d2b5f-fe32-4f20-948c-019b3cc1edd4 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.157196 Aug 18 21:08:20.355722 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 581/1170] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:20 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:20.794475 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:20.795094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:20.801507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:20.802563 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:20.802995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:20.803714 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:20.804163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:20.804587 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:20.948256 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:20.956573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5ebb172b-d3d0-4131-8d12-586c1c03ba0f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1265 microversion: 2.1 time: 0.165918 Aug 18 21:08:20.957240 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 590/1171] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:20 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:21.374377 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:21.374992 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:21.382611 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:21.383205 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:21.383680 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:21.384421 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:21.384903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:21.385339 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:21.529546 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:21.538435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2bdd4e02-4bff-4293-bc49-223e6422fa7e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.168188 Aug 18 21:08:21.539012 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 582/1172] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:21 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:21.978551 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:21.979223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:21.986216 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:21.986702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:21.987138 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:21.987889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:21.988342 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:21.988764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:22.132320 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:22.142944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-98da2f96-bb47-4a72-8873-8d2bd8847c34 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1452 microversion: 2.1 time: 0.167922 Aug 18 21:08:22.143563 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 591/1173] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:21 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:22.164751 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:22.165370 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:22.174990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:22.174990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:22.174990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:22.174990 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:22.175443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:22.175443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:22.309937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:22.318591 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-64ac4241-34c2-4e77-b5b4-7e3c472eb797 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1452 microversion: 2.1 time: 0.158812 Aug 18 21:08:22.319154 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 583/1174] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:22 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:22.559539 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:22.560187 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:22.566512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:22.566998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:22.568251 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:22.568962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:22.569418 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:22.569841 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:22.710545 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:22.719157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-97956ef9-7f46-4e8b-b23b-b8a357c0eb42 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.163560 Aug 18 21:08:22.719763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 592/1175] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:22 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:23.740453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:23.741069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:23.747812 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:23.748300 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:23.748729 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:23.749431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:23.749883 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:23.750307 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:23.991664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:24.000568 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-ff8f7451-5322-4a02-9ee8-1bf237881fdd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.264461 Aug 18 21:08:24.001158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 584/1176] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:23 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:24.698553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-e2e9f3fd-35a2-4e77-97df-9f0811d68879 req-dc17b1e0-3582-4f17-89ff-319bc7587fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4b9e9b-fced-4a35-8bf4-3c5c600266c7", "tag": "93ff712a-f831-4d10-abd7-d6db6e16b902"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:24.708863 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e2e9f3fd-35a2-4e77-97df-9f0811d68879 req-dc17b1e0-3582-4f17-89ff-319bc7587fdc service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:24.709336 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e2e9f3fd-35a2-4e77-97df-9f0811d68879 req-dc17b1e0-3582-4f17-89ff-319bc7587fdc service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:24.709764 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-e2e9f3fd-35a2-4e77-97df-9f0811d68879 req-dc17b1e0-3582-4f17-89ff-319bc7587fdc service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:24.721196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-e2e9f3fd-35a2-4e77-97df-9f0811d68879 req-dc17b1e0-3582-4f17-89ff-319bc7587fdc service nova] Creating event network-changed:93ff712a-f831-4d10-abd7-d6db6e16b902 for instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 on hv-cinder-85265 Aug 18 21:08:24.726081 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-e2e9f3fd-35a2-4e77-97df-9f0811d68879 req-dc17b1e0-3582-4f17-89ff-319bc7587fdc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095332 Aug 18 21:08:24.726671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 593/1177] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:08:25.020885 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:25.021672 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:25.028576 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:25.029092 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:25.029527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:25.030231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:25.030678 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:25.031098 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:25.166432 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:25.174691 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-07052b04-f1a8-4cb1-bddb-8c6da65cc0bd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.157666 Aug 18 21:08:25.175262 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 585/1178] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:25 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:26.197306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:26.197998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:26.204094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:26.204573 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:26.205009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:26.205703 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:26.206155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:26.206592 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:26.342260 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:26.352371 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-965055c6-602c-4502-ba0f-da3211407604 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.159621 Aug 18 21:08:26.352961 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 594/1179] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:26 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:27.373564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:27.374175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:27.381361 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:27.381891 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:27.386975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:27.386975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:27.386975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:27.386975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:27.511937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:27.520608 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-937c59a1-e8a0-42e6-9632-f8300e0450b6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.150874 Aug 18 21:08:27.521180 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 586/1180] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:27 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:28.542365 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:28.542983 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:28.549709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:28.550192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:28.550627 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:28.551861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:28.552311 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:28.552742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:28.690769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:28.700009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5905ea95-ad5b-4243-87a8-da5ce1371015 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.161476 Aug 18 21:08:28.705227 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 595/1181] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:28 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:29.368545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:08:29.368982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Thu Aug 18 21:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:08:29.721528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:29.722049 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:29.729065 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:29.729583 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:29.730026 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:29.730733 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:29.731184 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:29.731640 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:29.864748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:29.873379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6bf2cc56-a920-40b5-88b2-ca3ce4d47c2f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.155775 Aug 18 21:08:29.873957 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 587/1182] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:29 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:30.894277 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:30.894833 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:30.901530 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:30.901975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:30.902413 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:30.903114 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:30.903600 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:30.904030 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:31.039562 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:31.048009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-fb78d604-843a-4125-bcd4-d2a501082bb1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.157728 Aug 18 21:08:31.048807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 596/1183] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:30 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:32.070018 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:32.070687 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:32.077427 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:32.077917 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:32.078358 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:32.079064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:32.079551 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:32.079982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:32.207621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:32.215754 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-7b45e656-d06c-405e-9708-85e62974b01d tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1721 microversion: 2.1 time: 0.149565 Aug 18 21:08:32.216317 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 588/1184] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:32 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:33.236978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:33.237852 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:33.244877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:33.245442 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:33.245951 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:33.246760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:33.247223 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:33.247674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:33.468708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:33.477494 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dba62889-4b81-4209-8153-fa14ba5d7c35 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1698 microversion: 2.1 time: 0.244386 Aug 18 21:08:33.478205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 597/1185] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:33 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1698 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:33.498400 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a22dbb2f-a5c7-4ab7-a537-87013db13a6f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:33.504995 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22dbb2f-a5c7-4ab7-a537-87013db13a6f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:33.505486 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22dbb2f-a5c7-4ab7-a537-87013db13a6f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:33.505923 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a22dbb2f-a5c7-4ab7-a537-87013db13a6f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:33.566564 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a22dbb2f-a5c7-4ab7-a537-87013db13a6f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Going to try to start instance {{(pid=127937) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 21:08:33.752289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a22dbb2f-a5c7-4ab7-a537-87013db13a6f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action" status: 202 len: 0 microversion: 2.1 time: 0.257617 Aug 18 21:08:33.752903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 589/1186] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 21:08:33 2022] POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 21:08:33.762044 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:33.763208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:33.769601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:33.770092 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:33.770682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:33.771419 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:33.771884 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:33.772322 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:33.928502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:33.937861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-4c71aeba-089d-46a4-9f63-ec17f79defa6 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1707 microversion: 2.1 time: 0.179760 Aug 18 21:08:33.938441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 598/1187] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:33 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1707 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:08:34.959889 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:34.960813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:34.967622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:34.968214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:34.968772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:34.969542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:34.969999 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:34.970474 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:35.107519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:35.116483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-01891063-eeb0-4aaa-b887-4f47f96fe2cd tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1707 microversion: 2.1 time: 0.161897 Aug 18 21:08:35.117095 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 590/1188] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:34 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1707 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:36.137891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:36.138628 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:36.145561 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:36.146036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:36.146513 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:36.147309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:36.147884 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:36.148409 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:36.277435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:36.285811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-5c4c6e1e-9816-4e61-b6b0-79d76ce97cbc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1711 microversion: 2.1 time: 0.152358 Aug 18 21:08:36.286390 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 599/1189] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:36 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1711 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:37.713937 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:37.714462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:37.717028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=52 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:37.721851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:37.722337 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:37.722769 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:37.723503 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:37.723948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:37.724371 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:37.812919 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lazy-loading 'services' on Instance uuid ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:08:38.040446 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-250da217-3a9e-4077-a308-65278a80c861 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae/os-volume_attachments/1c15d0cb-c8bf-4205-8a94-b0c7bb96c16b" status: 202 len: 0 microversion: 2.1 time: 0.330188 Aug 18 21:08:38.041030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 591/1190] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:08:37 2022] DELETE /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae/os-volume_attachments/1c15d0cb-c8bf-4205-8a94-b0c7bb96c16b => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:08:39.165445 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:39.166033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:39.168359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=46 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:39.173128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:39.173640 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:39.174054 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:39.174756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:39.175245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:39.175645 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:39.202300 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:08:39.538192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-eded7bbd-47d8-46fb-9723-383e65fd8892 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 204 len: 0 microversion: 2.1 time: 0.376276 Aug 18 21:08:39.538924 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 600/1191] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:08:39 2022] DELETE /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:08:39.548225 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:39.548947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:39.555974 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:39.556443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:39.556873 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:39.557554 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:39.557997 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:39.558419 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:39.690840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:39.698804 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-a076dbc6-32f8-4905-a92c-c7d6496057ca tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1513 microversion: 2.1 time: 0.155423 Aug 18 21:08:39.699379 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 592/1192] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:39 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:40.719306 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:40.720029 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:40.726271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:40.726790 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:40.727228 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:40.727978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:40.728426 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:40.728851 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:40.862178 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:40.870860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c6bb4cc0-e8a7-4568-a726-eace6da4aaf0 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1513 microversion: 2.1 time: 0.155916 Aug 18 21:08:40.871590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 601/1193] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:40 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:41.891929 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:41.892833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:41.900257 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:41.900823 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:41.901268 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:41.902000 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:41.902471 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:41.902891 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:42.042663 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:42.050497 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3b2929f5-387d-49bc-9eae-733c8e26e357 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1513 microversion: 2.1 time: 0.162641 Aug 18 21:08:42.051858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 593/1194] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:41 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:42.371595 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-51aebba9-c1ab-4d0e-86b6-5bd00d45e723 req-ff378146-2ff3-40f0-b02b-9c055b1820c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae", "name": "network-vif-deleted", "tag": "9357ef33-7276-4f3d-81e2-1196b85bb636"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:08:42.382245 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-51aebba9-c1ab-4d0e-86b6-5bd00d45e723 req-ff378146-2ff3-40f0-b02b-9c055b1820c0 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:42.385703 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-51aebba9-c1ab-4d0e-86b6-5bd00d45e723 req-ff378146-2ff3-40f0-b02b-9c055b1820c0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:42.385703 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-51aebba9-c1ab-4d0e-86b6-5bd00d45e723 req-ff378146-2ff3-40f0-b02b-9c055b1820c0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:42.394660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-51aebba9-c1ab-4d0e-86b6-5bd00d45e723 req-ff378146-2ff3-40f0-b02b-9c055b1820c0 service nova] Creating event network-vif-deleted:9357ef33-7276-4f3d-81e2-1196b85bb636 for instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae on hv-cinder-85265 Aug 18 21:08:42.399528 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-51aebba9-c1ab-4d0e-86b6-5bd00d45e723 req-ff378146-2ff3-40f0-b02b-9c055b1820c0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031675 Aug 18 21:08:42.400124 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 602/1195] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:08:43.071320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:43.071972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:43.078696 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:43.079210 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:43.079738 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:43.080431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:43.080940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:43.081385 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:43.100909 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:43.113800 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:43.114282 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:43.114720 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:43.115177 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lazy-loading 'fault' on Instance uuid ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:08:43.159335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1149c7b88df4f94942b1d11557c6511', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff08af38e1ad4f20abd69335871f313a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:08:43.168385 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9e6c13f8-3346-452e-8907-cc928463c271 tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 200 len: 1308 microversion: 2.1 time: 0.100920 Aug 18 21:08:43.172056 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 594/1196] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:43 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:08:44.193227 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:08:44.193923 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] [instance: ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:08:44.200153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:44.200637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:44.201073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:44.201770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:08:44.202219 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:08:44.202654 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:08:44.216384 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] HTTP exception thrown: Instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae could not be found. Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Request method failure captured: Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae HTTP/1.1 Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qnUQrtQX16Txeu8TLkemOo3JSwyw9xEzjI32TYiE_XMFqoSj6_z5zO4_HpWuY0trcUX9nVKxErHES_73Jg6cWYO1H9v3QBHVwQL-LXtcs2V9uUbm9u0EwV542IRQPsvfJ3JekUiTDRGdKeTYhCmavxWcH7V-FOtP4bToJdsgYW6c1U Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: ff08af38e1ad4f20abd69335871f313a Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1437892956 Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:08:44.217988 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff08af38e1ad4f20abd69335871f313a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-VolumesSnapshotTestJSON-1437892956 Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: ff08af38e1ad4f20abd69335871f313a Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1437892956 Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-VolumesSnapshotTestJSON-1437892956-project Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: a1149c7b88df4f94942b1d11557c6511 Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-VolumesSnapshotTestJSON-1437892956-project Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae could not be found. Aug 18 21:08:44.219770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae'} Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae could not be found. Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:08:44.220763 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae could not be found. Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae could not be found. Aug 18 21:08:44.222399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:08:44.224134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] Returning 404 to user: Instance ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:08:44.224134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-53d68943-14ae-49f2-9ac8-e702c760288d tempest-VolumesSnapshotTestJSON-1437892956 tempest-VolumesSnapshotTestJSON-1437892956-project] 10.222.0.62 "GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae" status: 404 len: 111 microversion: 2.1 time: 0.031426 Aug 18 21:08:44.224134 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 603/1197] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:08:44 2022] GET /compute/v2.1/servers/ed5d6a5c-d1e7-4e75-9efb-17f321a3d2ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:08:45.942918 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:08:45.943631 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Thu Aug 18 21:08:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:09:43.275069 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:43.275789 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:43.277682 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=9 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:43.282800 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:43.283275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:43.283744 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:43.284443 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:43.284894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:43.285320 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:43.379903 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lazy-loading 'services' on Instance uuid cb392ede-a875-4d9d-92e6-f2470fd58a68 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:09:43.592376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-894d99c9-e248-46b5-bddf-e168239a67a9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-volume_attachments/418e1c42-ee1c-4a9a-a7da-8c1c36f4f434" status: 202 len: 0 microversion: 2.1 time: 0.321843 Aug 18 21:09:43.593881 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 595/1198] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:09:43 2022] DELETE /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-volume_attachments/418e1c42-ee1c-4a9a-a7da-8c1c36f4f434 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:09:44.722705 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:44.726810 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:44.727883 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0f50fe19-2f1d-4c6c-a7b5-ec19c091b03e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:09:44.733742 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0f50fe19-2f1d-4c6c-a7b5-ec19c091b03e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:44.734249 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0f50fe19-2f1d-4c6c-a7b5-ec19c091b03e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:44.734672 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0f50fe19-2f1d-4c6c-a7b5-ec19c091b03e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:44.757731 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0f50fe19-2f1d-4c6c-a7b5-ec19c091b03e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Going to try to stop instance {{(pid=127936) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 21:09:44.984187 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0f50fe19-2f1d-4c6c-a7b5-ec19c091b03e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action" status: 202 len: 0 microversion: 2.1 time: 0.262975 Aug 18 21:09:44.984702 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 604/1199] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 21:09:44 2022] POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:09:44.994449 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:44.995159 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:45.001509 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:45.001939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:45.002384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:45.003084 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:45.003578 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:45.004006 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:45.136234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:45.144558 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-91fe18fe-e698-4dbb-a66d-721d5a660ef2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.154870 Aug 18 21:09:45.145114 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 596/1200] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:44 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:46.166929 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:46.167651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:46.174072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:46.174552 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:46.174989 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:46.175706 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:46.176159 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:46.176584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:46.303858 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:46.311538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dc59a57f-d058-4b24-b3bf-1adc19b6de16 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.149963 Aug 18 21:09:46.312096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 605/1201] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:46 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:47.333487 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:47.334075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:47.340502 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:47.340976 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:47.341403 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:47.342084 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:47.342527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:47.342953 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:47.474542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:47.482189 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b267d3cf-eeb6-4bfd-9376-15ca5feba52f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.153171 Aug 18 21:09:47.482741 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 597/1202] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:47 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:48.503344 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:48.503975 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:48.511502 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:48.511985 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:48.512420 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:48.513112 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:48.513564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:48.513986 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:48.645547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:48.653199 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-84bef29b-1b3d-43ee-883c-c7467fe273e9 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.153737 Aug 18 21:09:48.653757 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 606/1203] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:48 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:49.675147 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:49.675761 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:49.682275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:49.682759 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:49.683197 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:49.683927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:49.684383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:49.684808 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:49.811669 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:49.820158 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-36b3ee86-2f5c-4dd5-8e66-33e2309438f5 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.149567 Aug 18 21:09:49.820726 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 598/1204] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:49 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:50.841333 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:50.841949 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:50.848330 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:50.848814 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:50.849255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:50.849944 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:50.850406 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:50.850832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:50.986222 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:50.995637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ac5c3ec8-dcbb-4756-9f31-72065e07a5db tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.158075 Aug 18 21:09:50.996109 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 607/1205] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:50 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:52.017183 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:52.018349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:52.024869 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:52.025375 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:52.025792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:52.026495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:52.026949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:52.027395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:52.168904 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:52.176818 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2c4e9b35-06f2-4ea8-be4f-f775c4884bbb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.163481 Aug 18 21:09:52.177383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 599/1206] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:52 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:53.197568 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:53.198169 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:53.205135 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:53.205611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:53.206042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:53.206727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:53.207173 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:53.207621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:53.332590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:53.340357 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-67b6eff4-5382-4e0b-88a4-ba414db3fda2 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.146724 Aug 18 21:09:53.340907 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 608/1207] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:53 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:54.361999 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:54.362613 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:54.369192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:54.369675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:54.370109 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:54.370799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:54.371249 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:54.371704 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:54.505501 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:54.513478 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-635e0736-a079-4b9b-a838-eaef937d5cc8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1675 microversion: 2.1 time: 0.155354 Aug 18 21:09:54.514047 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 600/1208] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:54 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:55.535728 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:55.536339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:55.543163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:55.543682 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:55.544122 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:55.544835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:55.545271 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:55.545733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:55.690787 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:55.699250 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b76fc16e-931d-44af-adb6-09b3350d44b7 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1652 microversion: 2.1 time: 0.167828 Aug 18 21:09:55.699854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 609/1209] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:55 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1652 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:55.719305 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f48f71c4-74d5-46fa-8f15-35242f0b82ec tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:09:55.725928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48f71c4-74d5-46fa-8f15-35242f0b82ec tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:55.726426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48f71c4-74d5-46fa-8f15-35242f0b82ec tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:55.726865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f48f71c4-74d5-46fa-8f15-35242f0b82ec tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:55.749864 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f48f71c4-74d5-46fa-8f15-35242f0b82ec tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Going to try to start instance {{(pid=127937) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 21:09:55.899086 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f48f71c4-74d5-46fa-8f15-35242f0b82ec tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action" status: 202 len: 0 microversion: 2.1 time: 0.183417 Aug 18 21:09:55.899664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 601/1210] 10.222.0.62 () {60 vars in 1278 bytes} [Thu Aug 18 21:09:55 2022] POST /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:09:55.908356 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:55.908973 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:55.915375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:55.915877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:55.919713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:55.919713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:55.919713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:55.919713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:56.049346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:56.057298 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-0a8561ac-7f51-46f0-91ce-7c0f47639e79 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1661 microversion: 2.1 time: 0.153297 Aug 18 21:09:56.058760 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 610/1211] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:55 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:57.080208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:57.080982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:57.087685 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:57.088175 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:57.088719 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:57.089355 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:57.089813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:57.090245 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:57.235854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:57.243521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-b6ddc7cf-2822-412e-900e-47306b6c5d3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1661 microversion: 2.1 time: 0.168620 Aug 18 21:09:57.244081 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 602/1212] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:57 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1661 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:09:58.265278 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:09:58.265946 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:09:58.272815 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:58.273290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:58.273720 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:58.274431 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:09:58.274877 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:09:58.275296 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:09:58.406718 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:09:58.414609 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-02680ea7-371d-41d1-a87e-80a2b33c4acb tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1665 microversion: 2.1 time: 0.153173 Aug 18 21:09:58.415167 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 611/1213] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:09:58 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:38.529217 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1747719802", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2088657920", "security_groups": [{"name": "tempest-secgroup-smoke-914677998"}], "block_device_mapping_v2": [{"uuid": "fdf85d80-228c-4728-af0b-5eae5564f10d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4a561f3f-ff1c-4783-b0f8-48e566defdc4"}]}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:10:38.539598 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=16 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:38.540260 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:38.643401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] validate_networks() for [('4a561f3f-ff1c-4783-b0f8-48e566defdc4', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:10:39.058028 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:10:39.058452 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:10:39.058922 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:10:39.059351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:10:39.059783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:10:39.069045 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:39.069517 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:39.069947 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:39.070674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:39.071118 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:39.071577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:39.088604 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:10:39.092588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Getting quotas for user e9c8beca893f40f08befa76dd712285f and project 4f044aa368374bfdbbe67eef66b02b28. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:10:39.148599 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:10:39.150721 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fdf85d80-228c-4728-af0b-5eae5564f10d',volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:10:39.513688 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-c387d718-4207-40c1-942e-4166cd8ea277 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.988486 Aug 18 21:10:39.514430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 603/1214] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:10:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:10:39.525624 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b87324e6-eb46-407b-899c-3d0b874f60c5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:39.526290 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b87324e6-eb46-407b-899c-3d0b874f60c5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:39.529848 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=16 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:39.530704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:39.583417 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b87324e6-eb46-407b-899c-3d0b874f60c5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:39.590943 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b87324e6-eb46-407b-899c-3d0b874f60c5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1095 microversion: 2.1 time: 0.068597 Aug 18 21:10:39.590943 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 612/1215] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:39 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:40.611858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:40.612479 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:40.618768 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:40.619244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:40.619707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:40.620404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:40.620850 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:40.621269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:40.686408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:40.694254 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-dc21a068-5eb4-4f33-b7b3-90c048947bd2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1137 microversion: 2.1 time: 0.086753 Aug 18 21:10:40.694813 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 604/1216] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:40 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:41.714843 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:41.715538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:41.723243 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:41.723756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:41.724195 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:41.724894 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:41.725346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:41.725773 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:41.803302 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:41.811748 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-395af704-9aa7-485c-893c-048af1f80492 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1211 microversion: 2.1 time: 0.100718 Aug 18 21:10:41.817657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 613/1217] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:41 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:42.832619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:42.833241 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:42.839836 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:42.840327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:42.840767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:42.841984 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:42.842437 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:42.842866 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:42.976275 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:42.984294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-e77eeaf3-af9d-4372-8bc5-afc6e273b822 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.155643 Aug 18 21:10:42.984865 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 605/1218] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:42 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:43.156164 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-709b8828-c074-408d-b6e3-473d370a62ed req-a382e5cf-f56d-43d8-a0aa-ccec8d08581c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad32789e-5b44-4a29-8832-59aad32a135f", "tag": "94138a42-ad3d-4b5e-8401-aacbd9626244"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:10:43.169968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-709b8828-c074-408d-b6e3-473d370a62ed req-a382e5cf-f56d-43d8-a0aa-ccec8d08581c service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:43.171077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-709b8828-c074-408d-b6e3-473d370a62ed req-a382e5cf-f56d-43d8-a0aa-ccec8d08581c service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:43.171309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-709b8828-c074-408d-b6e3-473d370a62ed req-a382e5cf-f56d-43d8-a0aa-ccec8d08581c service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:43.186782 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-709b8828-c074-408d-b6e3-473d370a62ed req-a382e5cf-f56d-43d8-a0aa-ccec8d08581c service nova] Creating event network-changed:94138a42-ad3d-4b5e-8401-aacbd9626244 for instance ad32789e-5b44-4a29-8832-59aad32a135f on hv-cinder-85265 Aug 18 21:10:43.191686 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-709b8828-c074-408d-b6e3-473d370a62ed req-a382e5cf-f56d-43d8-a0aa-ccec8d08581c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175166 Aug 18 21:10:43.192277 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 614/1219] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:10:44.004939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:44.005570 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:44.012005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:44.012491 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:44.012933 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:44.013675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:44.014131 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:44.014556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:44.145899 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:44.153539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-679be88b-a41b-4eeb-b213-2b675d919931 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.152475 Aug 18 21:10:44.154606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 606/1220] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:43 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:45.177588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:45.178375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:45.185832 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:45.186316 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:45.186756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:45.187478 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:45.187933 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:45.188363 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:45.318346 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:45.326045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bd12b167-78db-413c-a86e-3f87c2de1ba4 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.153240 Aug 18 21:10:45.326611 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 615/1221] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:45 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:46.346327 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:46.346949 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:46.353626 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:46.354113 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:46.354545 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:46.355258 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:46.355739 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:46.356169 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:46.492986 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:46.501693 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-6e764ba0-8e2e-472b-916c-332b0fa8efe5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.159148 Aug 18 21:10:46.502330 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 607/1222] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:46 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:47.522532 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:47.523121 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:47.529806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:47.530293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:47.530735 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:47.531463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:47.531920 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:47.532348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:47.661351 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:47.669211 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-2e994aee-8d24-45e5-b078-37034f3fb7f5 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.150563 Aug 18 21:10:47.670280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 616/1223] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:47 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:48.690199 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:48.690929 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:48.698447 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:48.698911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:48.699349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:48.700068 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:48.700523 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:48.701587 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:48.844835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:48.852969 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-3a740e12-32e4-46e6-97d1-37457bb7ae09 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.167298 Aug 18 21:10:48.853538 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 608/1224] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:48 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:49.873671 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:49.874292 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:49.876847 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=2 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:49.881596 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:49.882077 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:49.882515 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:49.883208 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:49.883691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:49.884121 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:50.019289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:50.027042 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-572d65f3-3b79-452b-afe3-edb85bce9eb9 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.157255 Aug 18 21:10:50.027644 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 617/1225] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:49 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:51.049291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:51.049904 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:51.051777 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:51.052458 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:51.057723 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:51.058204 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:51.063556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:51.063556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:51.063556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:51.063556 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:51.192469 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:51.200109 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2cf7845d-ad01-40e2-aae3-c96d54ab150a tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.155366 Aug 18 21:10:51.200666 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 609/1226] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:51 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:52.221078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:52.221689 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:52.228055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:52.228531 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:52.228960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:52.229642 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:52.230085 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:52.230506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:52.359194 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:52.366940 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8e9ad145-93e9-4414-a773-4804820fba57 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.150208 Aug 18 21:10:52.367537 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 618/1227] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:52 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:53.387476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:53.388194 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:53.395868 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:53.396354 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:53.396783 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:53.397483 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:53.397924 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:53.398349 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:53.538207 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:53.546198 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9ff40b84-5aab-4432-9d95-027487acaf91 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.162622 Aug 18 21:10:53.546765 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 610/1228] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:53 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:54.565788 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:54.566435 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:54.572874 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:54.573359 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:54.573793 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:54.574495 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:54.574945 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:54.575399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:54.712984 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:54.721041 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-29ab21fb-6f4d-4b95-a975-9d23b844027c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.159140 Aug 18 21:10:54.721601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 619/1229] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:54 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:55.358332 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-3850353a-09f1-4d21-af74-b16c05991cf7 req-3cccdf6e-ebcf-42db-9a58-7d323b414036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad32789e-5b44-4a29-8832-59aad32a135f", "name": "network-vif-plugged", "status": "completed", "tag": "94138a42-ad3d-4b5e-8401-aacbd9626244"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:10:55.367862 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-3850353a-09f1-4d21-af74-b16c05991cf7 req-3cccdf6e-ebcf-42db-9a58-7d323b414036 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:55.368851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-3850353a-09f1-4d21-af74-b16c05991cf7 req-3cccdf6e-ebcf-42db-9a58-7d323b414036 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:55.368851 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-3850353a-09f1-4d21-af74-b16c05991cf7 req-3cccdf6e-ebcf-42db-9a58-7d323b414036 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:55.380984 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-3850353a-09f1-4d21-af74-b16c05991cf7 req-3cccdf6e-ebcf-42db-9a58-7d323b414036 service nova] Creating event network-vif-plugged:94138a42-ad3d-4b5e-8401-aacbd9626244 for instance ad32789e-5b44-4a29-8832-59aad32a135f on hv-cinder-85265 Aug 18 21:10:55.386142 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-3850353a-09f1-4d21-af74-b16c05991cf7 req-3cccdf6e-ebcf-42db-9a58-7d323b414036 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091780 Aug 18 21:10:55.391507 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 611/1230] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:10:55.742003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:55.742621 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:55.749685 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:55.750151 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:55.750588 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:55.751289 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:55.751784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:55.752214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:55.913055 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:55.921641 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7e2f4e21-ca88-45cd-8fff-b2c18a16d5f6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.183575 Aug 18 21:10:55.922206 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 620/1231] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:55 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:56.943699 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:56.944420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:56.950524 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:56.950994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:56.951444 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:56.952749 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:56.953192 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:56.953609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:57.090521 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:57.098695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-53c3220b-e762-42fc-863b-139939141a8c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1266 microversion: 2.1 time: 0.159564 Aug 18 21:10:57.099269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 612/1232] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:56 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:58.119878 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:58.120512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:58.127533 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:58.128016 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:58.128448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:58.129135 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:58.129584 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:58.130007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:58.257009 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:58.264891 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-8c53d200-3faa-46ba-9ea1-6fce81b25f52 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1454 microversion: 2.1 time: 0.148866 Aug 18 21:10:58.265454 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 621/1233] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:58 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:10:58.285030 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:10:58.285631 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:10:58.292331 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:58.292803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:58.293227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:58.293906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:10:58.294351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:10:58.294767 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:10:58.428643 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:10:58.436495 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-58e84730-335c-4585-852b-b5683ea10d46 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1454 microversion: 2.1 time: 0.154656 Aug 18 21:10:58.437064 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 613/1234] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:10:58 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:00.615963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-1b0928d2-4a7f-4a3e-855a-2c96f6564dda req-f4d0e081-12b9-4e89-b71d-41b04e290032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad32789e-5b44-4a29-8832-59aad32a135f", "tag": "94138a42-ad3d-4b5e-8401-aacbd9626244"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:11:00.627086 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1b0928d2-4a7f-4a3e-855a-2c96f6564dda req-f4d0e081-12b9-4e89-b71d-41b04e290032 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:00.627695 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1b0928d2-4a7f-4a3e-855a-2c96f6564dda req-f4d0e081-12b9-4e89-b71d-41b04e290032 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:00.628207 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-1b0928d2-4a7f-4a3e-855a-2c96f6564dda req-f4d0e081-12b9-4e89-b71d-41b04e290032 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:00.641141 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-1b0928d2-4a7f-4a3e-855a-2c96f6564dda req-f4d0e081-12b9-4e89-b71d-41b04e290032 service nova] Creating event network-changed:94138a42-ad3d-4b5e-8401-aacbd9626244 for instance ad32789e-5b44-4a29-8832-59aad32a135f on hv-cinder-85265 Aug 18 21:11:00.646807 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-1b0928d2-4a7f-4a3e-855a-2c96f6564dda req-f4d0e081-12b9-4e89-b71d-41b04e290032 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034532 Aug 18 21:11:00.647971 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 622/1235] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:11:05.512815 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:05.515658 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:05.522511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:05.524566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:05.524566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:05.524566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:05.524887 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:05.525033 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:05.554959 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0e18114c-b0fb-4fe1-8dbf-9c0d4612281e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046062 Aug 18 21:11:05.555531 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 614/1236] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:11:05 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:11:05.622136 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:05.628076 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:05.629454 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:05.629938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:05.630387 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:05.631073 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:05.631586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:05.632014 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:05.659343 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:11:05.950938 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-549e2a87-f362-43ed-8d52-1fba4c7388ad tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 204 len: 0 microversion: 2.1 time: 0.332582 Aug 18 21:11:05.952063 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 623/1237] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:11:05 2022] DELETE /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:11:05.961278 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:05.961979 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:05.968856 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:05.969384 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:05.969951 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:05.970756 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:05.971342 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:05.971880 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:06.102784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:06.111711 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-22d81e7b-65b2-49a7-b115-e3c1baf4c036 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1671 microversion: 2.1 time: 0.154801 Aug 18 21:11:06.112281 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 615/1238] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:05 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:07.134007 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:07.134696 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:07.141154 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:07.141632 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:07.142064 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:07.142756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:07.143237 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:07.143691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:07.281651 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:07.289601 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e411d723-64ab-4d43-a779-09b92a8fbc51 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1671 microversion: 2.1 time: 0.160021 Aug 18 21:11:07.290163 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 624/1239] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:07 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:08.311251 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:08.311852 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:08.318401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:08.318930 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:08.319431 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:08.320122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:08.320577 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:08.321004 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:08.386171 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:08.400414 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-652ee474-c2be-452d-a5be-39cdd7c2ad44 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1604 microversion: 2.1 time: 0.093494 Aug 18 21:11:08.410928 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 616/1240] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:08 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:08.665806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-7c4829c2-7de4-4eb8-93d0-a021c02e8d70 req-8282e22d-935c-4817-918c-91b3215a98b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb392ede-a875-4d9d-92e6-f2470fd58a68", "name": "network-vif-deleted", "tag": "4c629978-1996-4de4-8529-a241038026a0"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:11:08.675704 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7c4829c2-7de4-4eb8-93d0-a021c02e8d70 req-8282e22d-935c-4817-918c-91b3215a98b3 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:08.676182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7c4829c2-7de4-4eb8-93d0-a021c02e8d70 req-8282e22d-935c-4817-918c-91b3215a98b3 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:08.676612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7c4829c2-7de4-4eb8-93d0-a021c02e8d70 req-8282e22d-935c-4817-918c-91b3215a98b3 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:08.688255 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-7c4829c2-7de4-4eb8-93d0-a021c02e8d70 req-8282e22d-935c-4817-918c-91b3215a98b3 service nova] Creating event network-vif-deleted:4c629978-1996-4de4-8529-a241038026a0 for instance cb392ede-a875-4d9d-92e6-f2470fd58a68 on hv-cinder-85265 Aug 18 21:11:08.693318 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-7c4829c2-7de4-4eb8-93d0-a021c02e8d70 req-8282e22d-935c-4817-918c-91b3215a98b3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031572 Aug 18 21:11:08.693903 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 625/1241] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:11:09.422029 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:09.422646 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:09.425120 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:09.430453 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:09.430948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:09.431401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:09.432116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:09.432571 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:09.433001 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:09.436477 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=77 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:09.489855 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:09.490184 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:09.490844 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:09.491291 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lazy-loading 'fault' on Instance uuid cb392ede-a875-4d9d-92e6-f2470fd58a68 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:11:09.537182 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:09.546594 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-4f257325-0ce4-4d2f-9fea-928be836351f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 200 len: 1326 microversion: 2.1 time: 0.129026 Aug 18 21:11:09.547168 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 617/1242] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:09 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:10.570668 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:10.571378 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:10.573391 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:10.578339 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:10.578833 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:10.579274 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:10.580001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:10.580461 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:10.580894 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:10.596196 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] HTTP exception thrown: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Request method failure captured: Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 HTTP/1.1 Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qmpT-Z4hfF9x4g_lmwpgk5Jc0mN7S1cG_-gwfofqxEC_LyM8FpKtHthKHyAs44JjdJ75ikaZr_pzwbkVfBwmjc_cQpRdxZzcg29u5Ch7DpYM3QcPXM6aboeLePw-7sn7KavEYffvqI1zn1dnU7v-J5C2usLjAwBOjltipObdz-hRXM Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:11:10.597831 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 48e346f5fa354c7cb5b83540c8b36531 Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:11:10.599806 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'cb392ede-a875-4d9d-92e6-f2470fd58a68'} Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:11:10.600960 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:11:10.602429 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:11:10.603811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Returning 404 to user: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:11:10.603811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c0f0de45-3ef6-49bd-b299-1f5dd44d0cdc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 404 len: 111 microversion: 2.1 time: 0.033263 Aug 18 21:11:10.603811 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 626/1243] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:10 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:11:10.608961 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-316b658d-10f5-4596-ba3a-fa7de5a3794c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '.version_select at 0x7f8b5a5098b0>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:10.677622 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-316b658d-10f5-4596-ba3a-fa7de5a3794c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92848817" status: 202 len: 0 microversion: 2.1 time: 0.073018 Aug 18 21:11:10.678209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 618/1244] 10.222.0.62 () {58 vars in 1215 bytes} [Thu Aug 18 21:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92848817 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:11:11.468309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-57dff75c-ab5b-4c47-806e-0f103dd6d975 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'create', calling method: .version_select at 0x7f8b5aec8280>, body: {"keypair": {"name": "tempest-keypair-2027889013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdlYNmnpBjX50zTGwUWJ/IkXgVT9+6AuS/9jNcAugltlbS7RYjM//M29VY+AW/8XMp63yaHhZD3CCwckZwzur93RmP9l0VF9k2HV3YNk1Ldt95vXDT5tropOjHyGz0/DQ=="}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:11:11.484545 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-57dff75c-ab5b-4c47-806e-0f103dd6d975 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for project 5d218206dcfd460a93035144c44ec2f6. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:11:11.488471 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.quota [None req-57dff75c-ab5b-4c47-806e-0f103dd6d975 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for user 48e346f5fa354c7cb5b83540c8b36531 and project 5d218206dcfd460a93035144c44ec2f6. Resources: {'key_pairs'} {{(pid=127936) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:11:11.557769 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-57dff75c-ab5b-4c47-806e-0f103dd6d975 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097103 Aug 18 21:11:11.558388 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 627/1245] 10.222.0.62 () {60 vars in 1159 bytes} [Thu Aug 18 21:11:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:11:13.798021 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1209336247", "imageRef": "1383a2a1-15a9-4938-a4db-5fb65d1a58d6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e317b70-c291-4424-b79c-bfd4fcabbab6"}], "security_groups": [{"name": "tempest-securitygroup--560331138"}], "key_name": "tempest-keypair-2027889013", "user_data": "}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:11:13.902588 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.network.neutron [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] validate_networks() for [('1e317b70-c291-4424-b79c-bfd4fcabbab6', None, None, None, None, None)] {{(pid=127937) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:11:14.271690 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Flavor limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:11:14.272111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Image limits 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:11:14.272641 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Flavor pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:11:14.273075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Image pref 0:0:0 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:11:14.273482 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.virt.hardware [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127937) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:11:14.282772 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:14.283247 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:14.283745 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:14.284444 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:14.284886 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:14.285303 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:14.302746 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for project 5d218206dcfd460a93035144c44ec2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:11:14.306675 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.quota [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Getting quotas for user 48e346f5fa354c7cb5b83540c8b36531 and project 5d218206dcfd460a93035144c44ec2f6. Resources: {'cores', 'instances', 'ram'} {{(pid=127937) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:11:14.317649 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Going to run 1 instances... {{(pid=127937) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:11:14.319958 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1383a2a1-15a9-4938-a4db-5fb65d1a58d6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127937) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:11:14.449546 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9b86e925-d9d2-4ee7-a619-978b60794014 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656814 Aug 18 21:11:14.450191 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 619/1246] 10.222.0.62 () {60 vars in 1147 bytes} [Thu Aug 18 21:11:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:11:14.462491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b3fdb68b-cce6-41bf-bd4d-760f18c48cda tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:14.463181 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b3fdb68b-cce6-41bf-bd4d-760f18c48cda tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:14.521801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-b3fdb68b-cce6-41bf-bd4d-760f18c48cda tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:14.529650 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b3fdb68b-cce6-41bf-bd4d-760f18c48cda tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1238 microversion: 2.1 time: 0.071103 Aug 18 21:11:14.530709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 628/1247] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:14 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:15.552424 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:15.553113 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:15.560515 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:15.561260 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:15.561710 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:15.562438 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:15.562894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:15.563323 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:15.627634 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:15.635606 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-8de93f76-a25e-491f-a78d-6e823f9cb839 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1242 microversion: 2.1 time: 0.087551 Aug 18 21:11:15.636214 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 620/1248] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:15 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:16.656946 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:16.657507 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:16.663503 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:16.664244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:16.664676 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:16.665361 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:16.665842 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:16.666280 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:16.668835 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:16.736016 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:16.743879 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d6e0de8c-9acf-478a-adcc-3cbb65337e3c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1298 microversion: 2.1 time: 0.091649 Aug 18 21:11:16.748111 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 629/1249] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:16 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:17.765906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:17.766539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:17.772891 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:17.773378 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:17.773820 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:17.774542 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:17.774982 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:17.775435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:17.909077 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:17.917504 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-9f75a7a8-817a-47c4-bf23-6d864a2e72a1 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1363 microversion: 2.1 time: 0.155857 Aug 18 21:11:17.920980 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 621/1250] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:17 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:18.145458 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-7743109a-4a68-4172-a033-eb3b46b21c5a req-9b274528-aeca-4605-bbfa-eaf687e78d26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd199d7-3dbe-403b-a313-842c9bf01f46", "tag": "e2e98c65-662a-45c1-968a-ac1467f38910"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:11:18.156854 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7743109a-4a68-4172-a033-eb3b46b21c5a req-9b274528-aeca-4605-bbfa-eaf687e78d26 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:18.157374 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7743109a-4a68-4172-a033-eb3b46b21c5a req-9b274528-aeca-4605-bbfa-eaf687e78d26 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:18.157809 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-7743109a-4a68-4172-a033-eb3b46b21c5a req-9b274528-aeca-4605-bbfa-eaf687e78d26 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:18.171590 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-7743109a-4a68-4172-a033-eb3b46b21c5a req-9b274528-aeca-4605-bbfa-eaf687e78d26 service nova] Creating event network-changed:e2e98c65-662a-45c1-968a-ac1467f38910 for instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 on hv-cinder-85265 Aug 18 21:11:18.177034 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-7743109a-4a68-4172-a033-eb3b46b21c5a req-9b274528-aeca-4605-bbfa-eaf687e78d26 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035070 Aug 18 21:11:18.177639 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 630/1251] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:11:18.938826 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:18.939415 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:18.945854 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:18.946335 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:18.946773 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:18.947566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:18.947948 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:18.948368 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:19.082091 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:19.089798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1920fafd-bbd8-4fdf-97ec-a96363b5ad46 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1363 microversion: 2.1 time: 0.155463 Aug 18 21:11:19.090370 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 622/1252] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:18 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:20.112368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:20.113070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:20.120366 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:20.120857 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:20.121294 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:20.122011 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:20.122463 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:20.122889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:20.280094 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:20.291434 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7be2f2d1-66be-4048-ab39-b1387a6574da tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1363 microversion: 2.1 time: 0.184075 Aug 18 21:11:20.292294 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 631/1253] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:20 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:21.314514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:21.315132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:21.321780 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:21.322269 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:21.322707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:21.323671 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:21.324117 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:21.324537 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:21.458526 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:21.466522 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-1ba55960-4d07-44bf-8cb0-2196bcdbe929 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1363 microversion: 2.1 time: 0.156507 Aug 18 21:11:21.467695 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 623/1254] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:21 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:22.489093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:22.489680 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:22.497360 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:22.497856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:22.498296 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:22.499003 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:22.499553 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:22.499984 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:22.635241 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:22.643970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-bcb6f4a8-1c80-4f06-ac08-0b624038b1af tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1363 microversion: 2.1 time: 0.158467 Aug 18 21:11:22.644926 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 632/1255] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:22 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:23.437304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-2540ea43-4303-4d9f-aaf0-5ce2fa2030f3 req-8c14c041-52e6-4afd-ad79-830cab5153d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd199d7-3dbe-403b-a313-842c9bf01f46", "name": "network-vif-plugged", "status": "completed", "tag": "e2e98c65-662a-45c1-968a-ac1467f38910"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:11:23.447160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2540ea43-4303-4d9f-aaf0-5ce2fa2030f3 req-8c14c041-52e6-4afd-ad79-830cab5153d2 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:23.447662 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2540ea43-4303-4d9f-aaf0-5ce2fa2030f3 req-8c14c041-52e6-4afd-ad79-830cab5153d2 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:23.448090 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-2540ea43-4303-4d9f-aaf0-5ce2fa2030f3 req-8c14c041-52e6-4afd-ad79-830cab5153d2 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:23.459401 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-2540ea43-4303-4d9f-aaf0-5ce2fa2030f3 req-8c14c041-52e6-4afd-ad79-830cab5153d2 service nova] Creating event network-vif-plugged:e2e98c65-662a-45c1-968a-ac1467f38910 for instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 on hv-cinder-85265 Aug 18 21:11:23.464713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-2540ea43-4303-4d9f-aaf0-5ce2fa2030f3 req-8c14c041-52e6-4afd-ad79-830cab5153d2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031572 Aug 18 21:11:23.465315 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 624/1256] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:11:23.665375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:23.665964 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:23.673224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:23.673727 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:23.674170 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:23.675018 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:23.675516 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:23.676517 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:23.853634 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:23.861491 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-ba9a701f-778f-4b50-a035-044d79cdd513 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1363 microversion: 2.1 time: 0.200233 Aug 18 21:11:23.862128 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 633/1257] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:23 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:24.882514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:24.883208 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:24.885174 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=2 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:24.885911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell0:SELECT=6 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:24.891748 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:24.892227 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:24.895407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:24.895407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:24.895407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:24.895407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:25.025862 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:25.034315 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-06676dfe-cd12-4b9b-9bc6-b0e44fc1856b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1363 microversion: 2.1 time: 0.155910 Aug 18 21:11:25.034888 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 625/1258] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:24 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:26.055097 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:26.055770 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:26.057696 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell0:SELECT=6 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:26.062881 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:26.063382 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:26.063870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:26.064564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:26.065023 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:26.065444 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:26.196456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:11:26.204295 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6fea89e4-ad0c-4143-a302-6e6a167aa66b tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1549 microversion: 2.1 time: 0.152992 Aug 18 21:11:26.204872 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 634/1259] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:11:26 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:11:26.224462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:11:26.224999 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:11:26.231436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:26.231916 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:26.232351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:26.233664 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:26.234125 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:26.234549 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:26.314874 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-53e784a7-ed5c-4acc-8497-70db44974a03 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094193 Aug 18 21:11:26.315530 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 626/1260] 10.222.0.62 () {58 vars in 1275 bytes} [Thu Aug 18 21:11:26 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:11:27.558192 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-18a76137-9373-4b95-9aa4-a29be79dd032 req-cafd7e8b-51e3-49fe-a96e-7e8d393a2249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd199d7-3dbe-403b-a313-842c9bf01f46", "tag": "e2e98c65-662a-45c1-968a-ac1467f38910"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:11:27.568633 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-18a76137-9373-4b95-9aa4-a29be79dd032 req-cafd7e8b-51e3-49fe-a96e-7e8d393a2249 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:11:27.569106 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-18a76137-9373-4b95-9aa4-a29be79dd032 req-cafd7e8b-51e3-49fe-a96e-7e8d393a2249 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:11:27.569535 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-18a76137-9373-4b95-9aa4-a29be79dd032 req-cafd7e8b-51e3-49fe-a96e-7e8d393a2249 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:11:27.581324 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-18a76137-9373-4b95-9aa4-a29be79dd032 req-cafd7e8b-51e3-49fe-a96e-7e8d393a2249 service nova] Creating event network-changed:e2e98c65-662a-45c1-968a-ac1467f38910 for instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 on hv-cinder-85265 Aug 18 21:11:27.586669 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-18a76137-9373-4b95-9aa4-a29be79dd032 req-cafd7e8b-51e3-49fe-a96e-7e8d393a2249 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032254 Aug 18 21:11:27.587265 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 635/1261] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:12:42.666430 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:42.667253 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=45 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:42.674512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:12:42.682234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:12:42.686773 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:42.687603 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:42.688381 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:42.689713 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:42.690569 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:42.691346 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:42.716513 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-71d16ae6-2cc0-4e54-8172-16a99d375870 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/ips" status: 200 len: 146 microversion: 2.1 time: 0.052556 Aug 18 21:12:42.717099 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 627/1262] 10.222.0.62 () {58 vars in 1248 bytes} [Thu Aug 18 21:12:42 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:12:44.410603 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:44.411456 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=33 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:44.416789 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f4b9369-ecb6-48fa-8257-34c43898e9c9"}} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:12:44.421407 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:12:44.429460 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:44.429962 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:44.430441 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:44.431174 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:44.431795 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:44.432232 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:45.382870 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-feaf3fad-d238-47be-a5d3-c9b5391e2336 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.974104 Aug 18 21:12:45.383526 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 636/1263] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:12:44 2022] POST /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments => generated 194 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:12:53.012022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:12:53.014393 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:12:53.023319 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:53.023840 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:53.024276 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:53.024996 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:53.025450 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:53.025874 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:53.060361 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-343ec0f5-f723-49a1-bd3f-4e3d8f39242e tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052434 Aug 18 21:12:53.061117 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 628/1264] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:12:53 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:12:53.074399 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:12:53.075043 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:12:53.081780 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:53.082279 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:53.082721 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:53.084067 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:53.084538 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:53.084970 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:53.119927 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-608dc952-34fa-49d4-9bfb-b9aeb2e2a26f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/1f4b9369-ecb6-48fa-8257-34c43898e9c9" status: 200 len: 194 microversion: 2.1 time: 0.050360 Aug 18 21:12:53.120570 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 637/1265] 10.222.0.62 () {58 vars in 1413 bytes} [Thu Aug 18 21:12:53 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/1f4b9369-ecb6-48fa-8257-34c43898e9c9 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:12:54.952396 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4df8466-589a-4111-bb22-8b906ebf40c3"}} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:12:54.954825 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:12:54.962469 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:54.963003 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:54.963441 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:54.964181 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:12:54.964659 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:12:54.965083 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:12:55.757975 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-261d7795-cbf6-4112-8aea-2b72c5ba04e8 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "POST /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.809332 Aug 18 21:12:55.758593 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 629/1266] 10.222.0.62 () {60 vars in 1323 bytes} [Thu Aug 18 21:12:54 2022] POST /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:13:04.485078 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:04.489394 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:04.493336 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_api:SELECT=4 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:04.494375 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:04.502177 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.502977 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.503717 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.504886 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.505644 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.506312 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.545647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6f1e7e7b-d2ee-490a-a3c0-f1d5c706839a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.067313 Aug 18 21:13:04.546606 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 638/1267] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:13:04 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:13:04.693566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:04.693566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:04.700293 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.701116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.701805 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.702566 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.703034 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.704179 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.745121 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:04.745725 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:04.753708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.754347 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.754856 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.755678 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.756209 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.756715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.757407 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-0d2b8ef8-731b-4ac3-9d08-c3f0297c5a84 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/1f4b9369-ecb6-48fa-8257-34c43898e9c9" status: 200 len: 194 microversion: 2.1 time: 0.069372 Aug 18 21:13:04.758541 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 630/1268] 10.222.0.62 () {58 vars in 1413 bytes} [Thu Aug 18 21:13:04 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/1f4b9369-ecb6-48fa-8257-34c43898e9c9 => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:13:04.768926 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-a07dc935-943b-4314-8d03-2ffb36796f96 req-e3b50e7f-bde0-4163-9ea3-67e7a1cc0d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad32789e-5b44-4a29-8832-59aad32a135f", "tag": "94138a42-ad3d-4b5e-8401-aacbd9626244"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:13:04.785398 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a07dc935-943b-4314-8d03-2ffb36796f96 req-e3b50e7f-bde0-4163-9ea3-67e7a1cc0d6f service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.786665 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a07dc935-943b-4314-8d03-2ffb36796f96 req-e3b50e7f-bde0-4163-9ea3-67e7a1cc0d6f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.786882 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:13:04.787613 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-a07dc935-943b-4314-8d03-2ffb36796f96 req-e3b50e7f-bde0-4163-9ea3-67e7a1cc0d6f service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.805568 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-a07dc935-943b-4314-8d03-2ffb36796f96 req-e3b50e7f-bde0-4163-9ea3-67e7a1cc0d6f service nova] Creating event network-changed:94138a42-ad3d-4b5e-8401-aacbd9626244 for instance ad32789e-5b44-4a29-8832-59aad32a135f on hv-cinder-85265 Aug 18 21:13:04.812318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-a07dc935-943b-4314-8d03-2ffb36796f96 req-e3b50e7f-bde0-4163-9ea3-67e7a1cc0d6f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051114 Aug 18 21:13:04.813351 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 631/1269] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:13:04.830572 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:04.831680 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:04.840304 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.846592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.846592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.846592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:04.846592 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:04.847451 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:04.956723 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lazy-loading 'services' on Instance uuid 8cd199d7-3dbe-403b-a313-842c9bf01f46 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:13:05.115248 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7d236a8a-dce3-4ba8-8d61-0851e58deb06 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 204 len: 0 microversion: 2.1 time: 0.373896 Aug 18 21:13:05.116070 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 639/1270] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:13:04 2022] DELETE /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:13:05.131987 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:05.134132 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:05.152860 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:05.154402 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:05.154889 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:05.156309 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:05.157468 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:05.158358 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:05.243270 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-03a082a8-ef33-4e6d-9051-3c1c58911c18 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/1f4b9369-ecb6-48fa-8257-34c43898e9c9" status: 202 len: 0 microversion: 2.1 time: 0.427430 Aug 18 21:13:05.249769 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 632/1271] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:13:04 2022] DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/1f4b9369-ecb6-48fa-8257-34c43898e9c9 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:13:05.408367 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:05.417637 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-6127580b-52bf-4190-9edc-a60e4b2316d2 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1577 microversion: 2.1 time: 0.295957 Aug 18 21:13:05.418348 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 640/1272] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:05 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1577 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:06.440764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:06.441476 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:06.448446 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:06.448940 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:06.449383 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:06.450129 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:06.450619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:06.451052 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:06.623954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:06.633248 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-82799e77-4066-4c2a-8889-6048e898f237 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1577 microversion: 2.1 time: 0.196792 Aug 18 21:13:06.633833 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 633/1273] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:06 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:07.667100 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:07.667768 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:07.675500 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:07.676069 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:07.676781 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:07.677754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:07.678525 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:07.679202 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:07.998793 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:08.007311 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-93444e49-ef05-4aef-8382-e8609f9a9765 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1460 microversion: 2.1 time: 0.344378 Aug 18 21:13:08.007942 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 641/1274] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:07 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1460 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:08.155619 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-7a744866-712c-4dc0-b316-0bbd73a11f12 req-4ae392a5-b667-4f86-b99d-4e3ec268e8e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad32789e-5b44-4a29-8832-59aad32a135f", "name": "network-vif-deleted", "tag": "94138a42-ad3d-4b5e-8401-aacbd9626244"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:13:08.167503 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-7a744866-712c-4dc0-b316-0bbd73a11f12 req-4ae392a5-b667-4f86-b99d-4e3ec268e8e0 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:08.167999 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-7a744866-712c-4dc0-b316-0bbd73a11f12 req-4ae392a5-b667-4f86-b99d-4e3ec268e8e0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:08.168441 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-7a744866-712c-4dc0-b316-0bbd73a11f12 req-4ae392a5-b667-4f86-b99d-4e3ec268e8e0 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:08.181962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-7a744866-712c-4dc0-b316-0bbd73a11f12 req-4ae392a5-b667-4f86-b99d-4e3ec268e8e0 service nova] Creating event network-vif-deleted:94138a42-ad3d-4b5e-8401-aacbd9626244 for instance ad32789e-5b44-4a29-8832-59aad32a135f on hv-cinder-85265 Aug 18 21:13:08.187567 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-7a744866-712c-4dc0-b316-0bbd73a11f12 req-4ae392a5-b667-4f86-b99d-4e3ec268e8e0 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035701 Aug 18 21:13:08.188498 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 634/1275] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:13:08.566118 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:08.566509 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:08.574864 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:08.575392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:08.575819 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:08.576726 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:08.577366 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:08.577969 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:08.612674 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-e7c4c0ec-d05e-4740-8b1d-9df8cd564428 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/e4df8466-589a-4111-bb22-8b906ebf40c3" status: 200 len: 194 microversion: 2.1 time: 0.050761 Aug 18 21:13:08.613483 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 642/1276] 10.222.0.62 () {58 vars in 1413 bytes} [Thu Aug 18 21:13:08 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/e4df8466-589a-4111-bb22-8b906ebf40c3 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:13:08.625408 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:08.630255 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:08.633076 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:08.633803 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:08.634234 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:08.634944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:08.635501 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:08.636111 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:08.739435 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.objects.instance [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lazy-loading 'services' on Instance uuid 8cd199d7-3dbe-403b-a313-842c9bf01f46 {{(pid=127937) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:13:08.947935 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-67b59bfb-aa8c-4d9f-b55e-b7c319abe62c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/e4df8466-589a-4111-bb22-8b906ebf40c3" status: 202 len: 0 microversion: 2.1 time: 0.326810 Aug 18 21:13:08.948528 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 635/1277] 10.222.0.62 () {58 vars in 1416 bytes} [Thu Aug 18 21:13:08 2022] DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments/e4df8466-589a-4111-bb22-8b906ebf40c3 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:13:09.028978 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:09.029629 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:09.036173 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:09.036662 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:09.038750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:09.038750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:09.038750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:09.038750 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:09.073377 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:09.073859 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:09.074293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:09.074737 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lazy-loading 'fault' on Instance uuid ad32789e-5b44-4a29-8832-59aad32a135f {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:13:09.133579 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:09.142368 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-7d65e5a5-98fc-4ff0-adc6-6f79aee23fb6 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 200 len: 1231 microversion: 2.1 time: 0.117172 Aug 18 21:13:09.142963 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 643/1278] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:09 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 1231 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:10.136732 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:10.138966 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:10.145297 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.145791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.146224 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.146955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.147426 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.147859 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.167995 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:10.168653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: ad32789e-5b44-4a29-8832-59aad32a135f] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:10.175577 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.177105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.177105 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.177865 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.178207 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.178631 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.180164 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-75cc4820-b385-4c96-8a18-d4327dbc827a tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048134 Aug 18 21:13:10.180755 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 636/1279] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:13:10 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:13:10.195652 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] HTTP exception thrown: Instance ad32789e-5b44-4a29-8832-59aad32a135f could not be found. Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Request method failure captured: Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f HTTP/1.1 Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qlJWNeP6nHlKIv4wEHSTZgbUGvvNKYQF1qr0U2qWkAmkwaXNcBzqZht--WFwmC-o5AEvm8YqJWTxk6g51FeIaMz-0ZchsGF-zuryqsD_eR1XP3KDEWh-KzXoK7t76tzMFKegSKb4bO7nSHIZi9Gte9tmRRvhd5VqmQS8TyTd1V7L_U Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:13:10.197310 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: e9c8beca893f40f08befa76dd712285f Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance ad32789e-5b44-4a29-8832-59aad32a135f could not be found. Aug 18 21:13:10.199204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'ad32789e-5b44-4a29-8832-59aad32a135f'} Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad32789e-5b44-4a29-8832-59aad32a135f could not be found. Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:10.200691 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad32789e-5b44-4a29-8832-59aad32a135f could not be found. Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad32789e-5b44-4a29-8832-59aad32a135f could not be found. Aug 18 21:13:10.203834 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:10.205427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Returning 404 to user: Instance ad32789e-5b44-4a29-8832-59aad32a135f could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:10.205427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-28cfcc82-2d53-4755-ae5d-c10297c87c68 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f" status: 404 len: 111 microversion: 2.1 time: 0.034755 Aug 18 21:13:10.205427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 644/1280] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:10 2022] GET /compute/v2.1/servers/ad32789e-5b44-4a29-8832-59aad32a135f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:13:10.306828 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:10.309029 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:10.314994 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.315519 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.315962 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.316774 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.317296 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.317668 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.352784 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2ef2f6c5-c7e8-4da7-873d-0b11b2fd02d0 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049826 Aug 18 21:13:10.353393 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 637/1281] 10.222.0.62 () {58 vars in 1302 bytes} [Thu Aug 18 21:13:10 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 21:13:10.421567 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:10.422220 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:10.432749 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.433664 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.434511 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.435765 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.436247 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.436653 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.478015 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:13:10.821138 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-dd996e68-6ddd-4aa4-b7b0-1663d2972484 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 204 len: 0 microversion: 2.1 time: 0.403152 Aug 18 21:13:10.821684 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 645/1282] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:13:10 2022] DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 21:13:10.830161 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:10.830775 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:10.837600 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.838103 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.838532 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.839240 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:10.839736 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:10.840164 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:10.980289 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:10.990462 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-65a4a1a8-a049-45f1-9065-caa353e19e0c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1674 microversion: 2.1 time: 0.162600 Aug 18 21:13:10.991075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 638/1283] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:10 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:12.013898 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:12.014605 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:12.021844 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:12.022338 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:12.022781 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:12.023586 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:12.023998 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:12.024427 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:12.164948 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:12.172950 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-90573321-52eb-4daa-81a9-79108888800c tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1674 microversion: 2.1 time: 0.163339 Aug 18 21:13:12.173913 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 646/1284] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:12 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:13.195878 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:13.196489 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:13.203244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:13.203793 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:13.204231 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:13.204955 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:13.205409 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:13.206046 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:13.399137 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:13.412439 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-66cc0203-a581-4aed-8e20-8cd28ca6575f tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1674 microversion: 2.1 time: 0.221774 Aug 18 21:13:13.413392 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 639/1285] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:13 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:14.296713 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:14.297888 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:14.304733 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:14.305209 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:14.305839 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:14.306539 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:14.307045 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:14.307622 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:14.320812 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-5784a956-d140-4e9c-86ca-cf33faf90f24 req-4fd2132c-20ab-4f67-8bb2-f25feea70ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c4b9e9b-fced-4a35-8bf4-3c5c600266c7", "tag": "93ff712a-f831-4d10-abd7-d6db6e16b902"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:13:14.335838 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5784a956-d140-4e9c-86ca-cf33faf90f24 req-4fd2132c-20ab-4f67-8bb2-f25feea70ba1 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:14.336123 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Going to try to terminate instance {{(pid=127936) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:13:14.336763 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5784a956-d140-4e9c-86ca-cf33faf90f24 req-4fd2132c-20ab-4f67-8bb2-f25feea70ba1 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:14.337632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-5784a956-d140-4e9c-86ca-cf33faf90f24 req-4fd2132c-20ab-4f67-8bb2-f25feea70ba1 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:14.361858 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-5784a956-d140-4e9c-86ca-cf33faf90f24 req-4fd2132c-20ab-4f67-8bb2-f25feea70ba1 service nova] Creating event network-changed:93ff712a-f831-4d10-abd7-d6db6e16b902 for instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 on hv-cinder-85265 Aug 18 21:13:14.368906 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-5784a956-d140-4e9c-86ca-cf33faf90f24 req-4fd2132c-20ab-4f67-8bb2-f25feea70ba1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052362 Aug 18 21:13:14.370798 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 640/1286] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:13:14.440108 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:14.441075 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:14.449005 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:14.449500 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:14.449946 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:14.450913 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:14.451621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:14.452230 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:14.530894 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:14.545871 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f300396e-8549-4531-ac75-bdfaef4063fe tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1607 microversion: 2.1 time: 0.112679 Aug 18 21:13:14.557021 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 641/1287] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:14 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1607 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:14.738910 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-cac36e95-34e2-4ea1-b49d-594872b5d19d tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "DELETE /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 204 len: 0 microversion: 2.1 time: 0.447257 Aug 18 21:13:14.741204 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 647/1288] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:13:14 2022] DELETE /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:13:14.750313 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:14.750936 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:14.768621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:14.771632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:14.772632 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:14.773876 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:14.774607 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:14.775217 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:14.938735 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:14.948963 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-fee52328-85fa-4990-bdb9-136e0460323f tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1577 microversion: 2.1 time: 0.203546 Aug 18 21:13:14.950547 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 642/1289] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:14 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:15.574398 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:15.580448 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:15.585869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:15.586647 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:15.587325 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:15.588367 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:15.589180 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:15.589829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:15.640481 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:15.641244 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:15.642033 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:15.642657 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lazy-loading 'fault' on Instance uuid 8cd199d7-3dbe-403b-a313-842c9bf01f46 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:13:15.687754 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48e346f5fa354c7cb5b83540c8b36531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d218206dcfd460a93035144c44ec2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:15.697825 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-debc0337-cb64-4af9-97dd-126515f324df tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 200 len: 1328 microversion: 2.1 time: 0.129922 Aug 18 21:13:15.698829 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 648/1290] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:15 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 1328 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:15.979712 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:15.980361 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:15.991085 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:15.991609 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:15.992047 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:15.992764 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:15.993209 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:15.993621 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:15.998388 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG dbcounter [-] [127937] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127937) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:16.158857 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:16.167661 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f9c519cf-405a-4d98-9638-f580155545de tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1577 microversion: 2.1 time: 0.191715 Aug 18 21:13:16.168244 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 643/1291] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:15 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:16.384991 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [req-3e35c0f9-421f-4a3d-ab59-a40b328e2ad3 req-961559dc-684f-4668-8e81-f219780c12b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd199d7-3dbe-403b-a313-842c9bf01f46", "name": "network-vif-deleted", "tag": "e2e98c65-662a-45c1-968a-ac1467f38910"}]} {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:13:16.394824 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3e35c0f9-421f-4a3d-ab59-a40b328e2ad3 req-961559dc-684f-4668-8e81-f219780c12b7 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:16.395564 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3e35c0f9-421f-4a3d-ab59-a40b328e2ad3 req-961559dc-684f-4668-8e81-f219780c12b7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:16.396069 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [req-3e35c0f9-421f-4a3d-ab59-a40b328e2ad3 req-961559dc-684f-4668-8e81-f219780c12b7 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:16.414825 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.compute.server_external_events [req-3e35c0f9-421f-4a3d-ab59-a40b328e2ad3 req-961559dc-684f-4668-8e81-f219780c12b7 service nova] Creating event network-vif-deleted:e2e98c65-662a-45c1-968a-ac1467f38910 for instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 on hv-cinder-85265 Aug 18 21:13:16.422521 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [req-3e35c0f9-421f-4a3d-ab59-a40b328e2ad3 req-961559dc-684f-4668-8e81-f219780c12b7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040824 Aug 18 21:13:16.423784 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 649/1292] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:13:16.720972 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:16.721373 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:16.728195 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:16.728683 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:16.729122 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:16.729927 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:16.730460 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:16.730888 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:16.745692 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] HTTP exception thrown: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Request method failure captured: Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 HTTP/1.1 Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qmpT-Z4hfF9x4g_lmwpgk5Jc0mN7S1cG_-gwfofqxEC_LyM8FpKtHthKHyAs44JjdJ75ikaZr_pzwbkVfBwmjc_cQpRdxZzcg29u5Ch7DpYM3QcPXM6aboeLePw-7sn7KavEYffvqI1zn1dnU7v-J5C2usLjAwBOjltipObdz-hRXM Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:13:16.747395 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 48e346f5fa354c7cb5b83540c8b36531 Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:16.749256 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '8cd199d7-3dbe-403b-a313-842c9bf01f46'} Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:16.750341 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:16.752160 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:16.753701 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Returning 404 to user: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:16.753701 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d1ab9edb-4e13-4ce8-a2c5-c1e8f7e563cc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 404 len: 111 microversion: 2.1 time: 0.032121 Aug 18 21:13:16.753701 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 644/1293] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:16 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:13:16.759968 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f9ba0265-9c70-456f-a438-163127846032 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '.version_select at 0x7f8b5a41f8b0>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:17.092772 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f9ba0265-9c70-456f-a438-163127846032 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027889013" status: 202 len: 0 microversion: 2.1 time: 0.338129 Aug 18 21:13:17.093251 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 650/1294] 10.222.0.62 () {58 vars in 1221 bytes} [Thu Aug 18 21:13:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2027889013 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:13:17.194238 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:17.194870 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:17.202200 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:17.202698 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:17.203130 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:17.204059 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:17.204511 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:17.205132 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:17.375019 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.policy [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127937) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:17.384527 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d5ad0c9b-a637-4726-aa3a-a8d237bd4cbe tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1225 microversion: 2.1 time: 0.193895 Aug 18 21:13:17.385707 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 645/1295] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:17 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1225 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:18.413267 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:18.414113 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:18.421709 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:18.422108 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:18.422549 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:18.423272 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:18.423758 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:18.424205 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:18.429512 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG dbcounter [-] [127936] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127936) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:18.460155 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:18.460663 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:18.461107 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:18.461566 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.objects.instance [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lazy-loading 'fault' on Instance uuid 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 {{(pid=127936) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:13:18.471835 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [req-b1158ffc-3cfc-4ec8-847e-fd99262f7070 req-aa919466-8f0e-4cd6-89f3-768b22124d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c4b9e9b-fced-4a35-8bf4-3c5c600266c7", "name": "network-vif-deleted", "tag": "93ff712a-f831-4d10-abd7-d6db6e16b902"}]} {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:13:18.483944 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b1158ffc-3cfc-4ec8-847e-fd99262f7070 req-aa919466-8f0e-4cd6-89f3-768b22124d72 service nova] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:18.496078 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b1158ffc-3cfc-4ec8-847e-fd99262f7070 req-aa919466-8f0e-4cd6-89f3-768b22124d72 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:18.496078 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [req-b1158ffc-3cfc-4ec8-847e-fd99262f7070 req-aa919466-8f0e-4cd6-89f3-768b22124d72 service nova] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:18.498472 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.compute.server_external_events [req-b1158ffc-3cfc-4ec8-847e-fd99262f7070 req-aa919466-8f0e-4cd6-89f3-768b22124d72 service nova] Creating event network-vif-deleted:93ff712a-f831-4d10-abd7-d6db6e16b902 for instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 on hv-cinder-85265 Aug 18 21:13:18.504318 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [req-b1158ffc-3cfc-4ec8-847e-fd99262f7070 req-aa919466-8f0e-4cd6-89f3-768b22124d72 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036205 Aug 18 21:13:18.505032 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 646/1296] 10.222.0.62 () {64 vars in 1317 bytes} [Thu Aug 18 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:13:18.520959 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.policy [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c8beca893f40f08befa76dd712285f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f044aa368374bfdbbe67eef66b02b28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127936) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:13:18.529093 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-c8461c77-c571-479f-bf31-51a3cabbdf8e tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 200 len: 1230 microversion: 2.1 time: 0.120775 Aug 18 21:13:18.529679 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 651/1297] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:18 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 1230 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:13:19.553610 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:19.554325 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:19.561512 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:19.562007 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:19.562446 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:19.563163 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:19.563652 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:19.564079 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:19.579424 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] HTTP exception thrown: Instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 could not be found. Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Request method failure captured: Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 HTTP/1.1 Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qlJWNeP6nHlKIv4wEHSTZgbUGvvNKYQF1qr0U2qWkAmkwaXNcBzqZht--WFwmC-o5AEvm8YqJWTxk6g51FeIaMz-0ZchsGF-zuryqsD_eR1XP3KDEWh-KzXoK7t76tzMFKegSKb4bO7nSHIZi9Gte9tmRRvhd5VqmQS8TyTd1V7L_U Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:13:19.581116 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: e9c8beca893f40f08befa76dd712285f Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 could not be found. Aug 18 21:13:19.583565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '2c4b9e9b-fced-4a35-8bf4-3c5c600266c7'} Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 could not be found. Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:19.587954 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 could not be found. Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 could not be found. Aug 18 21:13:19.589797 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:19.591149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Returning 404 to user: Instance 2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:19.591149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-2ec31544-6e22-4887-8e2e-3676a2c875b0 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7" status: 404 len: 111 microversion: 2.1 time: 0.034557 Aug 18 21:13:19.591149 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 647/1298] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:19 2022] GET /compute/v2.1/servers/2c4b9e9b-fced-4a35-8bf4-3c5c600266c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:13:20.158293 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:20.158867 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:20.167013 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.172026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.172026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.172026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.172026 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.172506 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.185170 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] HTTP exception thrown: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Request method failure captured: Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 HTTP/1.1 Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qlJWNeP6nHlKIv4wEHSTZgbUGvvNKYQF1qr0U2qWkAmkwaXNcBzqZht--WFwmC-o5AEvm8YqJWTxk6g51FeIaMz-0ZchsGF-zuryqsD_eR1XP3KDEWh-KzXoK7t76tzMFKegSKb4bO7nSHIZi9Gte9tmRRvhd5VqmQS8TyTd1V7L_U Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:13:20.186861 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: e9c8beca893f40f08befa76dd712285f Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.189756 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'e799d4da-faeb-4a1e-9014-d742d8218de1'} Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:20.191224 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.194331 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.196866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Returning 404 to user: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:20.196866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-d418ef73-cad5-4381-bd96-9f8dfcbbe2a3 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "DELETE /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 404 len: 111 microversion: 2.1 time: 0.034647 Aug 18 21:13:20.196866 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 652/1299] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:13:20 2022] DELETE /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:13:20.201358 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:20.202514 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] [instance: e799d4da-faeb-4a1e-9014-d742d8218de1] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:20.211926 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.220093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.220093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.220093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.220093 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.220644 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.229939 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] HTTP exception thrown: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Request method failure captured: Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 HTTP/1.1 Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qlJWNeP6nHlKIv4wEHSTZgbUGvvNKYQF1qr0U2qWkAmkwaXNcBzqZht--WFwmC-o5AEvm8YqJWTxk6g51FeIaMz-0ZchsGF-zuryqsD_eR1XP3KDEWh-KzXoK7t76tzMFKegSKb4bO7nSHIZi9Gte9tmRRvhd5VqmQS8TyTd1V7L_U Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:13:20.231565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/4f044aa368374bfdbbe67eef66b02b28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 4f044aa368374bfdbbe67eef66b02b28 Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-TestVolumeBootPattern-1681614469 Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: e9c8beca893f40f08befa76dd712285f Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-TestVolumeBootPattern-1681614469-project Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.233436 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': 'e799d4da-faeb-4a1e-9014-d742d8218de1'} Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:20.234404 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. Aug 18 21:13:20.236015 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.237792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Returning 404 to user: Instance e799d4da-faeb-4a1e-9014-d742d8218de1 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:20.237792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-d028cf56-6fe2-40d6-9337-7d2b110e1309 tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1" status: 404 len: 111 microversion: 2.1 time: 0.039050 Aug 18 21:13:20.237792 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 648/1300] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:20 2022] GET /compute/v2.1/servers/e799d4da-faeb-4a1e-9014-d742d8218de1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:13:20.745708 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:20.746214 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:20.753072 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.753560 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.754001 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.754698 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.755153 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.755648 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.769597 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] HTTP exception thrown: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Request method failure captured: Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 HTTP/1.1 Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qmpT-Z4hfF9x4g_lmwpgk5Jc0mN7S1cG_-gwfofqxEC_LyM8FpKtHthKHyAs44JjdJ75ikaZr_pzwbkVfBwmjc_cQpRdxZzcg29u5Ch7DpYM3QcPXM6aboeLePw-7sn7KavEYffvqI1zn1dnU7v-J5C2usLjAwBOjltipObdz-hRXM Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:13:20.771218 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 48e346f5fa354c7cb5b83540c8b36531 Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.772914 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': '8cd199d7-3dbe-403b-a313-842c9bf01f46'} Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:20.773869 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.775578 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.777261 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Returning 404 to user: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:20.777261 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-f5b75358-fce6-4654-96a9-a45bdcd9d291 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 404 len: 111 microversion: 2.1 time: 0.031177 Aug 18 21:13:20.777261 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 653/1301] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:13:20 2022] DELETE /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:13:20.785929 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:20.787035 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: 8cd199d7-3dbe-403b-a313-842c9bf01f46] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:20.798563 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.799565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.800287 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.802082 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:20.802911 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:20.803674 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:20.820839 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] HTTP exception thrown: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Request method failure captured: Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 HTTP/1.1 Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qmpT-Z4hfF9x4g_lmwpgk5Jc0mN7S1cG_-gwfofqxEC_LyM8FpKtHthKHyAs44JjdJ75ikaZr_pzwbkVfBwmjc_cQpRdxZzcg29u5Ch7DpYM3QcPXM6aboeLePw-7sn7KavEYffvqI1zn1dnU7v-J5C2usLjAwBOjltipObdz-hRXM Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:13:20.822420 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 48e346f5fa354c7cb5b83540c8b36531 Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.824312 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': '8cd199d7-3dbe-403b-a313-842c9bf01f46'} Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:20.826294 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. Aug 18 21:13:20.829170 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:20.830799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Returning 404 to user: Instance 8cd199d7-3dbe-403b-a313-842c9bf01f46 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:20.830799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-f0a0fba2-7b85-4ecb-a3fd-8367d7a29489 tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46" status: 404 len: 111 microversion: 2.1 time: 0.045945 Aug 18 21:13:20.830799 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 649/1302] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:20 2022] GET /compute/v2.1/servers/8cd199d7-3dbe-403b-a313-842c9bf01f46 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:13:21.961083 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-57ae60ae-17ea-45dc-a28a-bcfe704e115c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] Calling method '.version_select at 0x7f8b5ed12a60>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:22.092326 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-57ae60ae-17ea-45dc-a28a-bcfe704e115c tempest-TestVolumeBootPattern-1681614469 tempest-TestVolumeBootPattern-1681614469-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2088657920" status: 202 len: 0 microversion: 2.1 time: 0.135426 Aug 18 21:13:22.093157 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 654/1303] 10.222.0.62 () {58 vars in 1263 bytes} [Thu Aug 18 21:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2088657920 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 21:13:22.182215 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:22.183022 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.compute.api [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127937) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:22.194087 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:22.194902 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:22.195670 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:22.196848 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:22.197718 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:22.198376 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG oslo_concurrency.lockutils [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127937) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:22.215031 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.wsgi [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] HTTP exception thrown: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Request method failure captured: Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: request: DELETE /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 HTTP/1.1 Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept: application/json Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Accept-Encoding: identity Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Connection: close Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Length: 0 Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Content-Type: application/json Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Host: 10.222.0.62 Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Openstack-System-Scope: None Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Auth-Token: gAAAAABi_qmpT-Z4hfF9x4g_lmwpgk5Jc0mN7S1cG_-gwfofqxEC_LyM8FpKtHthKHyAs44JjdJ75ikaZr_pzwbkVfBwmjc_cQpRdxZzcg29u5Ch7DpYM3QcPXM6aboeLePw-7sn7KavEYffvqI1zn1dnU7v-J5C2usLjAwBOjltipObdz-hRXM Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Id: None Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Domain-Name: None Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Identity-Status: Confirmed Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Is-Admin-Project: True Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Id: default Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Domain-Name: Default Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Project-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Role: reader,member Aug 18 21:13:22.216602 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Roles: reader,member Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Id: default Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Domain-Name: Default Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Id: 48e346f5fa354c7cb5b83540c8b36531 Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: X-User-Name: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: method: > Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: exception: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.219565 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: action_args: {'id': 'cb392ede-a875-4d9d-92e6-f2470fd58a68'} Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: {{(pid=127937) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:22.220788 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.224127 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.226596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: DEBUG nova.api.openstack.wsgi [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Returning 404 to user: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. {{(pid=127937) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:22.226596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO nova.api.openstack.requestlog [None req-54c43623-6856-444c-a324-76e78010faea tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 404 len: 111 microversion: 2.1 time: 0.042695 Aug 18 21:13:22.226596 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: [pid: 127937|app: 0|req: 650/1304] 10.222.0.62 () {58 vars in 1239 bytes} [Thu Aug 18 21:13:22 2022] DELETE /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:13:22.232646 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Calling method '>' {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:13:22.233397 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.compute.api [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] [instance: cb392ede-a875-4d9d-92e6-f2470fd58a68] Fetching instance by UUID {{(pid=127936) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:13:22.241547 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:22.242038 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:22.242476 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:22.243182 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Acquiring lock "81167f5b-f1a0-4b68-bbb4-89664992faba" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:13:22.243715 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:13:22.244142 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG oslo_concurrency.lockutils [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Lock "81167f5b-f1a0-4b68-bbb4-89664992faba" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127936) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:13:22.258660 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.wsgi [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] HTTP exception thrown: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Request method failure captured: Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: request: GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 HTTP/1.1 Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept: application/json Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Accept-Encoding: identity Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Connection: close Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Length: 0 Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Content-Type: application/json Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Host: 10.222.0.62 Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Openstack-System-Scope: None Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: User-Agent: python-urllib3/1.26.11 Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Auth-Token: gAAAAABi_qmpT-Z4hfF9x4g_lmwpgk5Jc0mN7S1cG_-gwfofqxEC_LyM8FpKtHthKHyAs44JjdJ75ikaZr_pzwbkVfBwmjc_cQpRdxZzcg29u5Ch7DpYM3QcPXM6aboeLePw-7sn7KavEYffvqI1zn1dnU7v-J5C2usLjAwBOjltipObdz-hRXM Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Id: None Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Domain-Name: None Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Identity-Status: Confirmed Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Is-Admin-Project: True Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Id: default Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Domain-Name: Default Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Project-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Role: reader,member Aug 18 21:13:22.260238 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Roles: reader,member Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.62:8080", "publicURL": "http://10.222.0.62:8080/v1/AUTH_5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/5d218206dcfd460a93035144c44ec2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}] Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Id: 5d218206dcfd460a93035144c44ec2f6 Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1542848947 Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Id: default Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Domain-Name: Default Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Id: 48e346f5fa354c7cb5b83540c8b36531 Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: X-User-Name: tempest-AttachVolumeTestJSON-1542848947-project Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: method: > Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: exception: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.262125 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: action_args: {'id': 'cb392ede-a875-4d9d-92e6-f2470fd58a68'} Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: {{(pid=127936) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:13:22.263096 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. Aug 18 21:13:22.264801 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: ERROR nova.api.openstack.wsgi Aug 18 21:13:22.266374 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: DEBUG nova.api.openstack.wsgi [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] Returning 404 to user: Instance cb392ede-a875-4d9d-92e6-f2470fd58a68 could not be found. {{(pid=127936) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:13:22.269817 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO nova.api.openstack.requestlog [None req-b8d7c5e8-c321-46ae-a5af-15e3fe0505bc tempest-AttachVolumeTestJSON-1542848947 tempest-AttachVolumeTestJSON-1542848947-project] 10.222.0.62 "GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68" status: 404 len: 111 microversion: 2.1 time: 0.033497 Aug 18 21:13:22.270791 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: [pid: 127936|app: 0|req: 655/1305] 10.222.0.62 () {58 vars in 1236 bytes} [Thu Aug 18 21:13:22 2022] GET /compute/v2.1/servers/cb392ede-a875-4d9d-92e6-f2470fd58a68 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:13:28.913921 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:13:28.914791 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Thu Aug 18 21:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:13:29.139133 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:13:29.139748 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Thu Aug 18 21:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:13:29.378539 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:13:29.378715 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Thu Aug 18 21:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:16:48.923167 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:16:48.924345 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Thu Aug 18 21:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:16:49.148612 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:16:49.149307 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Thu Aug 18 21:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:16:49.389101 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:16:49.389348 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Thu Aug 18 21:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:18:45.959379 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:18:45.959996 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Thu Aug 18 21:18:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:18:46.915176 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:18:46.915843 dv-cinder-852654-2-iscsi devstack@n-api.service[127937]: Thu Aug 18 21:18:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:18:47.516392 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:18:47.517036 dv-cinder-852654-2-iscsi devstack@n-api.service[127936]: Thu Aug 18 21:18:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!